FORM PTO-1390 
(REV 5-93) 



U.S. DEPARTMENT OF COMMERCE 
PATENT AND TRADEMARK OFFICE 

TRANSMITTAL LETTER TO THE UNITED STATES 
DESIGNATED/ELECTED OFFICE (DO/EO/US) 
CONCERNING A FILING UNDER 35 U.S.C. 371 



ATTORNEY DOCKET NO. 
P1 0731 4-00020 



DATE: April 4, 2001 



U.S. APPLN. NO. 

(IF KNOWN, SEE 37 CFR 1.5) 

09/fl?U5? 



INTERNATIONAL APPLICATION NO. 
PCT/JP00/05129 



INTERNATIONAL FILING DATE 
July 28, 2000 



PRIORITY DATE CLAIMED 
Augusts, 1999 



TITLE OF INVENTION: IMAGE INTERPOLATING METHOD 



i 



APPLICANT(S) FOR DO/EO/US: Akihiro MAENAKA; Masahiko YOSHIYAMA; Susumu TANASE; Haruhiko MURATA 

1 . XX This is a FIRST submission of items concerning a filing under 35 U.S.C. 371 . 

(THE BASIC FILING FEE IS ATTACHED) 

2. This is a SECOND or SUBSEQUENT submission of items concerning a filing under 35 U.S.C. 371 . 

3. XX This express request to begin national examination procedures (35 U.S.C. 371 (f) at any time rather than delay examination until the 

expiration of the applicable time limit set in 35 U.S.C. 371(b) and PCT articles 22 and 39(1). 

4. _ A proper demand for International Preliminary Examination was made by the 19th month from the earliest claimed priority date. 

5. XX A copy of the International Application as filed (35 U.S.C. 371 (c)(2)) 

a. is transmitted herewith (required only if not transmitted by the International Bureau). 

b. XX has been transmitted by the International Bureau. 

c. is not required, as the application was filed in the United States Receiving Office (RO/US) 

6. XX A translation of the International Application into English (35 U.S.C. 371(c)(2)). 

7. Amendments to the claims of the International Application under PCT Article 1 9 (35 U.S.C. 371 (c)(3)) 

a. are transmitted herewith (required only if not transmitted by the International Bureau). 

b. have been transmitted by the International Bureau. 

c. have not been made; however, the time limit for making such amendments has NOT expired. 

d. have not been made and will not be made. 

8. _ A translation of the amendments to the claims under PCT Article 19 (35 U.S.C. 371 (c)(3)). 

9. XX An oath or declaration of the inventor(s) (35 U.S.C. 371(c)(4)). 

10. _ A translation of the annexes to the International Preliminary Examination Report under PCT Article 36 (35 U.S.C. 371 (c)(5)). 

(Amendment Under Article 34) 

Items 1 1 . to 16. below concern other document(s) or information included: 

1 1 . XX An Information Disclosure Statement under 37 CFR 1 .97 and 1 .98. 

12. XX An assignment document for recording. A separate cover sheet in compliance with 37 CFR 3.28 and 3.31 is included. 

13. XX A FIRST preliminary amendment. 

_ A SECOND or SUBSEQUENT preliminary amendment. 

14. A substitute specification. 

15. A change of power of attorney and/or address letter. 



16. XX Other items or information: 
Check No. 314297 
Drawing(s) 20 sheets 
International Search Report 
Notification of Receipt of Record Copy (PCT/IB/301) 
Notification Concerning Submission of Priority Documents (PCT/IB/304) 
Notice Informing the Applicant of the Communication of the International 

Application to the Designated Offices (PCT/IB/308) 
Front Page of International Bulletin No. WO 01/1 1879 A1 



JC08 Rec'd PCT/PTO 0 4 APR 200) 



U.S. APPLN. NO. (IF KNOWN, SEE 37 

OFR,50, n9/82l*5l 


INTERNATIONAL APPLICATION 
NO. PCT/JPOO/05129 


ATTORNEY DOCKET NO. P107314-00020 


DATE: April 4, 2001 


A ^7 \/\/ Y a f 1 I/mi it rSAi Trtrto o oi ir\rvi i^j^^i " 

i /. aa i ne toi lowing Tees are suDrniueu. 
Basic National Fee (37 CFR 1.492(a)(1)-(5): 

Search Report has been prepared by the EPO or JPO $860.00 

International preliminary examination fee paid to USPTO (37 CFR 1.482)....$690.00 
No international preliminary examination fee paid to USPTO (37 CFR1 .482) but 

international search fee paid to USPTO (37 CFR 1.445(a)(2)) $760.00 

Neither international preliminary examination fee (37 CFR 1.482) or international 

search fee (37 CFR 1.445(a)(2)) paid to USPTO $1,000.00 

International preliminary examination fee paid to USPTO (37 CFR 1 .482) and all 
claims satisfied provisions of PCT Article 33(2)-(4) $100.00 


CALCULATIONS , PTO USE ONLY 


ENTER APPROPRIATE BASIC FEE AMOUNT = 


$ 860.00 




Surcharge of $130.00 for furnishing the oath or declaration later than _ 20 _ 30 
months from the earliest claimed priority date (37 CFR 1 .492(e)). 






Claims 


Number Filed 


Number Extra 


Rate 






Total Claims 


32 - 20 = 


12 


X$ 18.00 


216.00 




Independent Claims 


4- 3 = 


1 


X $ 80.00 


80.00 




Multiole dependent ciaim(s) (if applicable) 


+ $270.00 






TOTAL OF ABOVE CALCULATIONS = 


$ 1156.00 




Reduction by 1/2 for filing by small entity, if applicable. 
Verified Small Entity statement must also be filed. 
(Note 37 CFR 1.9, 1.27, 1.28). 






SUBTOTAL = 


$ 1156.00 




Processing fee of $130.00 for furnishing the English translation later the _ 20 _ 30 
months from the earliest claimed priority date (37 CFR 1 .492(f)). + 






TOTAL NATIONAL FEE = 


$ 1156.00 




Fee for recording the enclosed assignment (37 CFR 1 .21(h)). The assignment must 
be accompanied by an appropriate cover sheet (37 CFR 3.28, 3.31 ). $40.00 per 
property + 


$ 40.00 




TOTAL FEES ENCLOSED = 


$ 1196.00 






Amount to be refunded 


$ 


Charged 


$ 


a. XX A check in the amount of $ 1196.00 to cover the above fees is enclosed. 

h Please charqe my Deposit Account No. 01 -2300 in the amount of $ to cover the above fees. A duplicate copy of this sheet is 
enclosed. 

c. XX The Commissioner is hereby authorized to charge any additional fees which may be required, or credit any overpayment to Deposit 
Account No. 01-2300 . 

NOTE: Where an appropriate time limit under 37 CFR 1.494 or 1.495 has not been met, a petition to revive (37 CFR 1.137(a) or (b)) 
must be filed and granted to restore the application to pending status. 

SEND ALL CORRESPONDENCE TO: >n ,x 

Arent Fox Kintner Plotkin & Kahn, PLLC (I O ^T) V 
1050 Connecticut Avenue, N.W., Suite 600 /^yyT/Aj/tf f f L* Avi 
Washington, D.C. 20036-5339 J^V^^^^^/^ 1 *^ l J0> 
Telephone No. (202) 857-6000 George EC0>ram, Jr. / 
Facsimile No. (202) 638-4810 Reg. No. 27,931 / / 



09/821 452 

JCOB Rec'd PCT/PTG 0 4 APR 200f 



IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



In re application of: 



MAENAKA et al. 



Serial No.: New Application 



Group Art Unit: 



Filed: April 4, 2001 



Examiner: 
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PRELIMINARY AMENDMENT 

Commissioner for Patents 

Washington, D.C. 20231 April 4, 2001 

Sir: 

Prior to calculation of the filing fee and prior to the examination of this 
application, please amend the above-identified application as follows: 

IN THE SPECIFICATION : 

Please amend the specification as follows. A copy of the marked-up 
specification is attached showing the changes as set forth in amended 37 C.F.R. 1.121. 

Page 37, please replace the paragraph starting at line 17 with the 
following paragraph: 

The foregoing equation (21 ) can be changed, as expressed by the 
following equations (23), from the relationship between the correlation value L and the 
pixel data x shown in Fig. 4. 



L = xd + 2 (x - x max ) 



(x } X max ) 



L = xd 



( X min - X - X max) 



L = xd + 2(x min -x) (x<x min ) ...(23).- 

Page 61 , please replace the paragraph starting at line 21 (continuing onto 
page 62) with the following paragraph: 

When xd = x max - x min + p1 X H1 - (32 X V1 , the correlation value L 
expressed by the foregoing equation (33) can be changed, as in the following equations 
(43). The correlation value R can be similarly changed: 

L = xd + 2(x-x m J (x)x max ) 

L = xd (x min < x < x max ) 

L = xd + 2(x min -x) (x<x min ) ...(43).- 



REMARKS 

The above amendment to the specification claims have been to put the 
application in better condition for examination. No new matter has been added. 

In the event that any fees are due in connection with this paper, please 
charge our Deposit Account No. 01-2300. 
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Reg. No. 27,931 

Atty. Docket No.: P1 07314-00020 
Arent Fox Kintner Plotkin & Kahn, PLLC 
1050 Connecticut Avenue, N.W., Suite 600 
Washington, D.C. 20036-5339 
Telephone No. (202) 857-6000 
Facsimile No. (202) 638-4810 
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pixel data may be determined as the pixel data xl 
in the case where the minimum correlation value L min 
is given. Similarly, when a plurality of pixel data 
are applicable as the pixel data xr in the case where 
the minimum correlation value R min is given, the 
average of the pixel data may be determined as the 
pixel data xr in the case where the minimum 
correlation value Rmin is given. 

(2) Description of Second Method 

Fig. 4 illustrates the relationship between the 
correlation value L and the pixel data x. In Fig, 
4, x miia denotes the smaller one of the pixel data dll 
and d23 on the opposed pixels Dll and D23, and x max 
denotes the larger one of the pixel data dll and d23. 
xd denotes the difference ( x ma x - x min ) between the 
pixel data dll and d23. 

The foregoing equation (21) can be changed, as 
expressed by the following equations (23) , from the 
relationship between the correlation value L and the 
pixel data x shown in Fig. 4, 

L = xd + 2 (x (x > x max ) 

L = Xd ( X m in ^ X ^X max ) 

L = xd + 2(x min -x) (x < x min ) *" (23) 

Although only equations for changing the 
correlation value L are shown, the correlation value 
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Hr denotes the larger one of an amount of change 
Hr of d 1 3 to dl 5 found by the following equation (39) 
and an amount of change Hr2 of d21 to d23 found by 
the following equation (40) . That is, Hr = MAX ( H r 1 , 
Hr 2 ) . 

Vr denotes the smaller one of an amount of change 
Vrl of d!2 to d32 found by the following equation 
(41) and an amount of change Vr2 of d04 to d24 found 
by the following equation (42) . That is, Vr = 
MI N ( Vr 1 , Vr 2 ) . 

Hrl = I dl3-dl4 ! + |dl4-d!5| (39) 
Hr2 - |d21-d22| + |d22-d23| ••• (40) 
Vrl = |dl2-d22{ + |d22-d32| (41) 
Vr2 - ! d04-dl4 | + |d!4~d24| (42) 
Fig. 14 illustrates the relationship between 
the correlation value L and the pixel data x. In 
Fig. 14, x min denotes the smaller one of the pixel 
data dl2 and d24 f -and x max denotes the larger one of 
the pixel data dl2 and d24. Further, xd *= x max - x min 
+ J3 1 X HI - £2 XVI. 

When xd = x ma x - x miri + |Jl X HI - ?2 X VI, the 
correlation value L expressed by the foregoing 
equation (33) can be changed, as in the following 
equations (43) . The correlation value R can be 
similarly changed: 
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L « xd + 2(x-s^trtTr) (x > x max ) 

L = xd ( x mi n ^ x ^ x max ) 

L = xd + 2(x min -x) (x < x min ) (43) 

Minimum correlation values L m i n and Rmin and 
pixel data xl and xr can be found in the method 
described in the second method at the step 3 shown 
in Fig. 2, that is, the same method as the method 
described using Fig. 5. In this case, xd in the graph 
shown in Fig, 5 indicates x max - x m i n + j3 1 X HI - /3 
2 X vi . 

When the minimum correlation values L min and R m ± n 
and the pixel data xl and xr in a case where the 
minimum correlation values are respectively given 
are found at the step 16, the pixel data 
corresponding to the smaller one of the minimum 
correlation values L mLn and R min is extracted (step 
17) . 

When the minimum correlation values L min and R m ±n 
differ from each other, one pixel data is extracted. 
When the minimum correlation values L^n and R m in are 
the same, two pixel data are extracted. 

When one pixel data xl or xr is extracted at the 
step 17 (YES at step 18) , the extracted pixel data 
is determined as the pixel data x on the interpolated 
pixel X (step 19) . When two (a plurality of) pixel 
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DESCRIPTION 



IMAGE INTERPOLATING METHOD 



<Technical Field> 

The present invention relates to an image 
interpolating method for interpolating an image. 

<Background Art> 

Conventionally in cases such as a case where an 
interlace image is converted into a progressive 
image, a case where an image is enlarged, and a case 
where the resolution of an image is enhanced, various 
methods of interpolating an image have been proposed 
using pixel data on adjacent original pixels 
(corresponding to the amount of data representing 
luminance on a display) . 



method are a simple interpolating method and a linear 
interpolating method. The simple interpolating 
method is a method of giving pixel data on either 
one of pixels adjacent to a pixel to be interpolated 
on the upper and lower sides (or on the right and 
left sides) to the pixel to be interpolated as pixel 
data. The linear interpolating method is a method 
of giving the average of pixel data on pixels 



Typical examples of an image interpolating 



adjacent to a pixel to be interpolated on the upper 
and lower sides (on the right and left sides) to the 
pixel to be interpolated as pixel data. 

In the simple interpolating method, however, 
the pixel data on the pixel adjacent to the pixel 
to be interpolated is given as it is. When there 
is a diagonal edge portion in an image reproduced 
^ on a display or the like, backlash occurs in the edge 

o m 

= t j portion. On the other hand, in the linear 

M 

rl| interpolating method, the average of the pixel data 

»Z on the pixels adjacent to the pixel to be 

rii interpolated on the upper and lower sides (on the 

= j right and left sides) is given. Accordingly, the 

vicinity of the pixel to be interpolated is an edge 
: ~ portion. When the difference between the pixel data 

on the pixels adjacent to the pixel to be 
interpolated on the upper and lower sides (on the 
right and left sides) is large, the interpolated 
pixel takes an intermediate value , so that the edge 
portion is blurred. 

The present invention provides an image 
interpolating method capable of preventing backlash 
and blur from occurring in an edge portion in 
interpolating an image as well as capable of 
reproducing a smooth image. 
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<Disclosure of Invention) 

[1] Description of First Image Interpolating Method 
According to Present Invention 

In an image interpolating method for 
interpolating a pixel at an intermediate position 
between a first original pixel and a second original 
pixel adjacent to the first original pixel, a first 
image interpolating method according to the present 
invention is characterized by comprising a first 
step of calculating an edge component for judging 
whether or not an interpolated pixel exists in the 
vicinity of an edge position of original image data; 
a second step of finding a range where pixel data 
on the interpolated pixel is settable on the basis 
of the calculated edge component and pixel data on 
the first and second original pixels; a third step 
of selecting a plurality of sets of opposed pixels 
between which the interpolated pixel is sandwiched 
diagonally, and finding, for each of the sets, the 
pixel data on the interpolated pixel in a case where 
a correlation value represented by the sum of the 
absolute values of the differences between the pixel 
data on the interpolated pixel and pixel data on the 
opposed pixels is the minimum in the range where the 



pixel data on the interpolated pixel is settable and 
the minimum correlation value; and a fourth step of 
finding the pixel data on the interpolated pixel on 
the basis of the pixel data on the interpolated pixel 
in the case where the correlation value is the 
minimum and the minimum correlation value which are 
found for each of the sets. 

When an original pixel adjacent to the first 
original pixel and opposite to the second original 
pixel is taken as a third original pixel, and an 
original pixel adjacent to the second original pixel 
and opposite to the first original pixel is taken 
as a fourth original pixel, the edge component is 
calculated on the basis of pixel data on the first 
to fourth original pixels at the first step. 

More specifically, letting dl be the pixel data 
on the first original pixel, d2 be the pixel data 
on the second original pixel, d3 be the pixel data 
on the third original pixel, and d4 be the pixel data 
on the fourth original pixel, an edge component E 
is calculated on the basis of the following equation 

(1) : 

E = -d3 + dl + d2 - d4 ( 1 ) 

Letting E be the edge component found at the 
first step, Th be a predetermined threshold, d ma x be 



the larger one of the pixel data on the first original 
pixel and the pixel data on the second original 
pixel, d min be the smaller one of them, and d be 
dmax-dmin, a range S where the pixel data on the 
interpolated pixel is settable is found on the basis 
of the following expression (2) at the second step: 
if E > Th, then d mi n + d/2 ^ S ^ d ma x , 
if -Th ^ E ^ Th, then d min + d/4 ^ S S d max - 
d / 4 , and 

if E < -Th, then d mxn ^ S ^ d min + d/2 "* (2) 

Letting x be the pixel data in the settable range 
S found at the second step, and da and db be 
respectively the pixel data on the two original 
pixels composing one set of opposed pixels, a 
correlation value L corresponding to the set is 
calculated by the following equation ( 3 ) : 
L = | da-x | + | db-x | ■•• ( 3 ) 

Used as the fourth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the third 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 



interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and determining, 
when there are a plurality of minimums of the minimum 
correlation values, the average of the pixel data 
on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given as the pixel data on the 
interpolated pixel. 

Used as the fourth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the third 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and extracting, when 
there are a plurality of minimums of the minimum 
correlation values, the maximum and the minimum of 
the pixel data on the interpolated pixel in a case 
where the minimums of the minimum correlation values 
are respectively given, and determining the average 



of the extracted maximum and minimum as the pixel 
data on the interpolated pixel. 

Used as the fourth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the third 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and selecting, when 
there are a plurality of minimums of the minimum 
correlation values, the pixel data obtained from 
opposed pixels in closest proximity to the 
interpolated pixel out of the pixel data on the 
interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 
given, and determining, when the number of the 
selected pixel data is one, the pixel data as the 
pixel data on the interpolated pixel, while 
determining, when the number of the selected pixel 
data is two, the average of the pixel data as the 
pixel data on the interpolated pixel. 



[2] Description of Second Image Interpolating Method 
According to Present Invention 

In an image interpolating method for 
interpolating a pixel at an intermediate position 
between a first original pixel and a second original 
pixel adjacent to the first original pixel, a second 
image interpolating method according to the present 
invention is characterized by comprising a first 
step of calculating an edge component for judging 
whether or not an interpolated pixel exists in the 
vicinity of an edge position of original image data; 
a second step of correcting the calculated edge 
component on the basis of a predetermined pseudo 
noise component; a third step of finding a range 
where pixel data on the interpolated pixel is 
settable on the basis of an edge component after the 
correction and pixel data on the first and second 
original pixels; a fourth step of selecting a 
plurality of sets of opposed pixels between which 
the i n t e r p o 1 a t e d p i x e 1 is sandwiched diagonally, and 
finding, for each of the sets, the pixel data on the 
interpolated pixel in a case where a correlation 
value represented by the sum of the absolute values 
of the differences between the pixel data on the 
interpolated pixel and pixel data on original pixels 
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in the vicinity of the opposed pixels is the minimum 
in the range where the pixel data on the interpolated 
pixel is settable and the minimum correlation value; 
and a fifth step of finding the pixel data on the 
interpolated pixel on the basis of the pixel data 
on the interpolated pixel in the case where the 
correlation value is the minimum and the minimum 
correlation value which are found for each of the 
„ sets. 

a 

When an original pixel adjacent to the first 

! ii 

] 'Z original pixel and opposite to the second original 

fl\ pixel is taken as a third original pixel, and an 

Q: original pixel adjacent to the second original pixel 

q and opposite to the first original pixel is taken 

rj as a fourth original pixel, the edge component is 

calculated on the basis of pixel data on the first 
to fourth original pixels at the first step. 

More specifically, letting dl be the pixel data 
on the first original pixel, d2 be the pixel data 
on the second original pixel, d3 be the pixel data 
on the third original pixel, and d4 be the pixel data 
on the fourth original pixel, an edge component E 
is calculated on the basis of the following eguation 
( 4 ) : 

E = -d3 + dl + d2 - d4 (4) 
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Letting Q be a pseudo noise component, and E be 
the edge component calculated at the first step, an 
edge component El after the correction found at the 
second step is given by the following expression (5) : 
if -Q ^ E ^ Q, then El = 0, and 
if E > Q or E < -Q, then El - E *** (5) 

Letting El be the edge component after the 
correction found at the second step, d ma x be the 
larger one of the pixel data on the first original 
pixel and the pixel data on the second original 
pixel, d miri be the smaller one of them, dc be the 
average of d ma x and d min , and a (0 ^ a ^ 1) and y 
be previously set factors, a range S where the pixel 
data on the interpolated pixel is settable is found 
on the basis of the following expression (6) at the 
third step: 

if El ^ 0, then d m i n *ct + dc(l-a) ^ S ^ d ma x - 
a + dc(l-a) + E 1 • y , and 

if El < 0, then d min -a + d c ( 1 - a ) + El - 7 = S 
^ d ma x • a + dc(l-a) ( 6 ) 

When a direction connecting the first original 
pixel and the second original pixel is defined as 
a vertical direction, a direction perpendicular to 
the vertical direction is defined as a right- 
and-left direction, a set of opposed pixels is taken 
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as D12 and D24, two original pixels adjacent to the 
one opposed pixel D12 on the right and left sides 
are taken as Dll and D13, two original pixels 
adjacent to the opposed pixel D12 on the upper and 
lower sides are taken as D02 and D22, two original 
pixels adjacent to the other opposed pixel D24 on 
the right and left sides are taken as D23 and D25, 
two original pixels adjacent to the opposed pixel 
D24 on the upper and lower sides are taken as D14 
and D34 , pixel data on the original pixels D02, Dll, 
D12, D13, D14, D22, D23 , D24, D25, and D34 are 
respectively taken as d02, dll, d 1 2 , dl3 f dl4, d22, 
d23, d24, d25, and d34, j3 1 and j3 2 are taken as 
predetermined factors, and the pixel data in the 
settable range S found at the third step is taken 
as x, an equation for calculating the correlation 
value L corresponding to the set is expressed by the 
following equations (7) : 

L = |dl2-x| + |d24-x| + j8l-Hl - 0 2 -VI 
HI = MAX{ ( | dll-dl2 | + | dl2-dl3 | ) , (|d23-d24| + 
I d 2 4 - d 2 5 | ) } 

VI = MIN{ ( | d02-dl2 | + | dl 2 -d2 2 | ) , ( | dl 4 -d2 4 | + 
1 d 2 4 - d 3 4 | ) } ( 7 ) 

Used as the fifth step is one comprising the 
steps of selecting the minimum of the minimum 



correlation values found for the sets at the fourth 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given , determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and determining, 
when there are a plurality of minimums of the minimum 
correlation values, the average of the pixel data 
on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given as the pixel data on the 
interpolated pixel. 

Used as the fifth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the fourth 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 



data on the interpolated pixel, and extracting, when 
there are a plurality of m i n i m u m s of the minimum 
correlation values, the maximum and the minimum of 
the pixel data on the interpolated pixel in a case 
where the minimums of the minimum correlation values 
are respectively given, and determining the average 
of the extracted maximum and minimum as the pixel 
data on the interpolated pixel. 

Used as the fifth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the fourth 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and selecting, when 
there are a plurality of minimums of the minimum 
correlation values, the pixel data obtained from 
opposed pixels in closest proximity to the 
interpolated pixel out of the pixel data on the 
interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 



given, and determining, when the number of the 
selected pixel data is one, the pixel data as the 
pixel data on the interpolated pixel, while 
determining, when the number of the selected pixel 
data is two, the average of the pixel data as the 
pixel data on the interpolated pixel. 

[3] Description of Third Image Interpolating Method 
According to Present Invention 

In an image interpolating method for 
interpolating a pixel at a central position among 
four original pixels comprising a first original 
pixel and a second original pixel which are adjacent 
to each other on the right and left sides, a third 
pixel adjacent to the first original pixel on the 
lower side, and a fourth pixel adjacent to the second 
original pixel on the lower side, a third image 
interpolating method according to the present 
invention is characterized by comprising a first 
step of calculating a first edge component for 
judging whether or not an interpolated pixel exists 
in the vicinity of an edge position of original image 
data on the basis of pixel data on the first original 
pixel, the fourth original pixel, a fifth original 
pixel on an extension of a line connecting the first 
original pixel and the fourth original pixel and 



adjacent to the first original pixel diagonally to 
the upper left, and a sixth original pixel on the 
extension of the line connecting the first original 
pixel and the fourth original pixel and adjacent to 
the fourth original pixel diagonally to the lower 
right; a second step of calculating a second edge 
component for judging whether or not the 
interpolated pixel exists in the vicinity of the edge 
Q position of the original image data on the basis of 

1:^ pixel data on the second original pixel, the third 

l *2 original pixel, a seventh original pixel on an 

|:j f extension of a line connecting the second original 

}^ pixel and the third original pixel and adjacent to 

at- 

r=T the second original pixel diagonally to the upper 

=;j right, and an eighth original pixel on the extension 

|5 St.- 

of the line connecting the second original pixel and 
the third original pixel and adjacent to the third 
original pixel diagonally to the lower left; a third 
step of finding a first range where pixel data on 
the interpolated pixel is settable on the basis of 
the first edge component and the pixel data on the 
first and fourth original pixels and a second range 
where the pixel data on the interpolated pixel is 
settable on the basis of the second edge component 
and the pixel data on the second and third original 
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pixels; a fourth step of judging whether or not 
portions which are overlapped with each other exist 
in the first settable range and the second settable 
range; a fifth step of calculating, when there exist 
no portions which are overlapped with each other in 
the first settable range and the second settable 
range, the average of the pixel data on the first 
to fourth original pixels, and determining the 

3 result of the calculation as the pixel data on the 

interpolated pixel; a sixth step of setting, when 

2 there exist portions which are overlapped with each 

; i 

jj other in the first settable range and the second 

3; settable range, the overlapped portions as a 

J settable range, then selecting a plurality of sets 

J of opposed pixels between which the interpolated 

pixel is sandwiched diagonally, and finding, for 
each of the sets, the pixel data on the interpolated 
pixel in a case where a correlation value represented 
by the sum of the absolute values of the differences 
between the pixel data on the interpolated pixel and 
pixel data on the opposed pixels is the minimum in 
the range where the pixel data on the interpolated 
pixel is settable and the minimum correlation value; 
and a seventh step of finding the pixel data on the 
interpolated pixel on the basis of the pixel data 
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on the interpolated pixel in the case where the 
correlation value is the minimum and the minimum 
correlation value which are found for each of the 
sets at the sixth step. 

Letting dl be the pixel data on the first 
original pixel, d4 be the pixel data on the fourth 
original pixel, d5 be the pixel data on the fifth 
original pixel, d6 be the pixel data on the sixth 
original pixel, and EL be a first edge component, 
the first edge component EL is calculated on the 
basis of the following equation (8) at the first 
step. Further, letting d2 be the pixel data on the 
second original pixel, d3 be the pixel data on the 
third original pixel, d7 be the pixel data on the 
seventh original pixel, d8 be the pixel data on the 
eighth original pixel, and ER be a second edge 
component, the second edge component ER is 
calculated on the basis of the following equation 
(9) at the second step. 

EL = -d5 + dl + d4 - d6 *** (8) 

ER = -d7 + d2 + d3 - d8 (9) 

Letting EL be the first edge component, ER be 
the second edge component, Th be a predetermined 
threshold, dL ma x be the larger one of the pixel data 
on the first original pixel and the pixel data on 



1 7 



the fourth original pixel, dL min be the smaller one 
of them, dL be d L ma x - d L m i n , dR m ax be the larger one of 
the pixel data on the second original pixel and the 
pixel data on the third original pixel, dR min be the 
smaller one of them, and dR be dR m ax-dR m inr a- first 
settable range SL and a second settable range SR are 
respectively found on the basis of the following 
expressions (10) and (11) at the third step: 

if EL > Th, then dL min + dL/2 ^ SL ^ dL max , 
if -Th ^ EL ^ Th , then dL min + dL/4 ^ SL ^ dL max 

- dL/4 , and 

if EL < -Th, then dL min ^ SL ^ dL min + dL/2 

••• (10) 

if ER > Th, then dR min + dR/2 ^ SR ^ dR max , 
if -Th ^ ER ^ Th, then dR min + dR/4 ^ SR ^ dRmax 

- dR/ 4 , and 

if ER < -Th, then dR min ^ SR ^ dR min + dR/2 

(11) 

Letting x be the pixel data in the settable range 
S set at the sixth step, and da and db be respectively 
the pixel data on the two original pixels composing 
one set of opposed pixels, a correlation value L 
corresponding to the set is calculated by the 
following equation (12) : 

L = | d a - x | + | db-x | *" (12) 
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Used as the seventh step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the sixth 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and determining, 
when there are a plurality of minimums of the minimum 
correlation values, the average of the pixel data 
on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given as the pixel data on the 
interpolated pixel. 

Used as the seventh step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the sixth 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 



interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and extracting, when 
there are a plurality of minimums of the minimum 
correlation values, the maximum and the minimum of 
the pixel data on the interpolated pixel in a case 
where the minimums of the minimum correlation values 
are respectively given, and determining the average 
of the extracted maximum and minimum as the pixel 
data on the interpolated pixel. 

Used as the seventh step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the sixth 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and selecting, when 
there are a plurality of minimums of the minimum 
correlation values, the pixel data obtained from 
opposed pixels in closest proximity to the 
interpolated pixel out of the pixel data on the 
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interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 
given, and determining, when the number of the 
selected pixel data is one, the pixel data as the 
pixel data on the interpolated pixel, while 
determining, when the number of the selected pixel 
data is two, the average of the pixel data as the 
pixel data on the interpolated pixel. 

[4] Description of Fourth Image Interpolating Method 
According to Present Invention 

In an image interpolating method for 
interpolating a pixel at a central position among 
four original pixels comprising a first original 
pixel and a second original pixel which are adjacent 
to each other on the right and left sides, a third 
pixel adjacent to the first original pixel on the 
lower side, and a fourth pixel adjacent to the second 
original pixel on the lower side, a fourth image 
interpolating method according to the present 
invention is characterized by comprising a first 
step of calculating a first edge component for 
judging whether or not an interpolated pixel exists 
in the vicinity of an edge position of original image 
data on the basis of pixel data on the first original 
pixel, the fourth original pixel, a fifth original 
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pixel on an extension of a line connecting the first 
original pixel and the fourth original pixel and 
adjacent to the first original pixel diagonally to 
the upper left, and a sixth original pixel on the 
extension of the line connecting the first original 
pixel and the fourth original pixel and adjacent to 
the fourth original diagonally to the lower right; 
a second step of calculating a second edge component 
3. for judging whether or not the interpolated pixel 

^ exists in the vicinity of the edge position of the 

Z original image data on the basis of pixel data on 

the second original pixel, the third original pixel, 
a seventh original pixel on an extension of a line 
connecting the second original pixel and the third 
original pixel and adjacent to the second original 
pixel diagonally to the upper right, and an eighth 
original pixel on the extension of the line 
connecting the second original pixel and the third 
original pixel and adjacent to the third original 
pixel diagonally to the lower left; a third step of 
respectively correcting the calculated first and 
second edge components on the basis of predetermined 
pseudo noise components; a fourth step of finding 
a first range where pixel data on the interpolated 
pixel is settable on the basis of a first edge 
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component after the correction and the pixel data 
on the first and fourth original pixels and a second 
range where the pixel data on the interpolated pixel 
is settable on the basis of a second edge component 
after the correction and the pixel data on the second 
and third original pixels; a fifth step of judging 
whether or not portions which are overlapped with 
each other exist in the first settable range and the 
second settable range; a sixth step of calculating, 
when there exist no portions which are overlapped 
with each other in the first settable range and the 
second settable range, the average of the pixel data 
on the first to fourth original pixels, and 
determining the result of the calculation as the 
pixel data on the interpolated pixel; a seventh step 
of setting, when there exist portions which are 
overlapped with each other in the first settable 
range and the second settable range, the overlapped 
portions as a settable range, then selecting a 
plurality of sets of opposed pixels between which 
the interpolated pixel is sandwiched diagonally, and 
finding, for each of the sets, the pixel data on the 
interpolated pixel in a case where a correlation 
value represented by the sum of the absolute values 
of the differences between the pixel data on the 



interpolated pixel and pixel data on the opposed 
pixels and pixel data on original pixels in the 
vicinity of the opposed pixels is the minimum in the 
range where the pixel data on the interpolated pixel 
is settable and the minimum correlation value; and 
an eighth step of finding the pixel data on the 
interpolated pixel on the basis of the pixel data 
on the interpolated pixel in the case where the 
correlation value is the minimum and the minimum 
^ correlation value which are found for each of the 

sets. 

::: S3*: 
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Letting dl 


be the pixel data on the first 


3 


original pixel, 


d4 be the pixel data on the fourth 
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original pixel, 


d5 be the pixel data on the fifth 




original pixel, 


and d6 be the pixel data on the sixth 




original pixel, 


and EL be a first edge component, 




the first edge 


component EL is calculated on the 



basis of the following equation (13) at the first 
step. Further, letting d2 be the pixel data on the 
second original pixel, d3 be the pixel data on the 
third original pixel, d7 be the pixel data on the 
seventh original pixel, and d8 be the pixel data on 
the eighth original pixel, and ER be a second edge 
component, the second edge component ER is 
calculated on the basis of the following equation 



(14) at the second step: 

EL = -d5 + dl + d4 - d6 — (13) 

ER = -d7 + d2 + d3 - d8 (14) 
Letting Q be a pseudo noise component, EL be the 
first edge component, and ER be the second edge 
component, a first edge component ELI after the 
correction and a second edge component E R 1 after the 
correction which are found at the third step are 
respectively given by the following expressions (15) 
and (16): 

if -Q S EL ^ Q, then ELl = 0, and 
if EL > Q or EL < -Q, then ELI - EL *" (15) 

if -Q ^ ER ^ Q, then ERl = 0, and 
if ER > Q or ER < - Q , then ERl = ER *** (16) 

Letting ELl be the first edge component after 
the correction, ERl be the second edge component 
after the correction, dL max be the larger one of the 
pixel data on the first original pixel and the pixel 
data on the fourth original pixel, dL min be the 
smaller one of them, dLc be the average of dL max and 
dL min , dRmax be the larger one of the pixel data on 
the second original pixel and the pixel data on the 
third original pixel, dR mxn be the smaller one of 
them, dRc be the average of dR max and dRmin, and a 
and y be previously set factors, a first settable 



range SL and a second settable range SR are 
respectively found on the basis of the following 
expressions (17) and (18) at the fourth step: 

if ELI ^ 0, then dL min • a + dLc ( 1- a ) ^ SL ^ dL max ■ 
a + dLc(l-a) + E L 1 • y , and 

if ELI < 0, then dL min - a + dLc(l-a) + ELI - 7 ^ 
SL^ dL max -a + dLc(l-a) *** ( 17 ) 

if ER1 ^ 0 f then dR min - a + dRc(l-a) ^ SR ^ 
dRmax-a + dRc(l-a) + E R 1 ■ y , and 

if ER1 < 0, then dR mi n-ct + dRc(l-a) + E R 1 * y ^ 
SR^ dR m ax*a + dRc(l-a) "* < 18 > 

Letting x be the pixel data in the settable range 
S set at the seventh step, and da and db be 
respectively the pixel data on the two original 
pixels composing one set of opposed pixels, a 
correlation value L corresponding to the set is 
calculated by the following equation (19) : 

L = 1 da-x | + 1 db-x | --(19) 

Used as the eighth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the seventh 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 



correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and determining, 
when there are a plurality of minimums of the minimum 
correlation values, the average of the pixel data 
on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given as the pixel data on the 
interpolated pixel. 

Used as the eighth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the seventh 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and extracting, when 
there are a plurality of minimums of the minimum 
correlation values, the maximum and the minimum of 
the pixel data on the interpolated pixel in a case 
where the minimums of the minimum correlation values 



are respectively given, and determining the average 
of the extracted maximum and minimum as the pixel 
data on the interpolated pixel. 

Used as the eighth step is one comprising the 
steps of selecting the minimum of the minimum 
correlation values found for the sets at the seventh 
step, extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, determining, 
when the number of minimums of the minimum 
correlation values is one, the pixel data on the 
interpolated pixel in a case where the minimum of 
the minimum correlation values is given as the pixel 
data on the interpolated pixel, and selecting, when 
there are a plurality of minimums of the minimum 
correlation values, the pixel data obtained from 
opposed pixels in closest proximity to the 
interpolated pixel out of the pixel data on the 
interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 
given, and determining, when the number of the 
selected pixel data is one, the pixel data as the 
pixel data on the interpolated pixel, while 
determining, when the number of the selected pixel 
data is two, the average of the pixel data as the 
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pixel data on the interpolated pixel 



<Brief Description of Drawings) 

Fig. 1 is a schematic view showing the 
relationship between original pixels and an 
interpolated pixel. 

Fig. 2 is a flow chart showing the procedure for 
a first image interpolating method. 

Fig. 3 is a graph of an edge component E against 
a range S where pixel data x on an interpolated pixel 
X is settable. 

Fig. 4 is a graph of a correlation value L 

against pixel data x. 

Figs. 5(a) to 5(f) are graphs of a correlation 
value L against pixel data x and schematic views 
showing a range S where pixel data is settable. 

Fig. 6 is a schematic view showing the 
relationship between original pixels and an 
interpolated pixel. 

Fig. 7 is a block diagram showing the 
configuration of a first image interpolating device. 

Fig. 8 is a block diagram showing the 
configuration of a second image interpolating 
device . 

Fig. 9 is a schematic view for explaining the 
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dvantage of the first image interpolating method. 
Fig. 10 is a flow chart showing the procedure 
for a second image interpolating method. 

Fig. 11 is a schematic view showing the 
relationship between original pixels and an 
interpolated pixel. 

Fig. 12 is a graph of an edge component E against 
an edge component El after correction. 

Figs. 13(a) and 13(b) are schematic views 
showing a range S where pixel data x on an 
interpolated pixel X is settable. 

Fig. 14 is a graph of a correlation value L 
against pixel data x. 

Fig. 15 is a schematic view showing the 
relationship between original pixels and an 
interpolated pixel. 

Fig. 16 is a schematic view for explaining the 
advantage of the second image interpolating method. 

Fig. 17 is a schematic view for explaining the 
advantage of the second image interpolating method. 

Fig. 18 is a schematic view showing the 
relationship between original pixels and an 
interpolated pixel. 

Fig. 19 is a flow chart showing the procedure 
for a third image interpolating method. 



Figs. 20(a) and 20(b) are schematic views 
showing the relationship between a first settable 
range SL and a second settable range SR. 

Fig. 21 is a flow chart showing the procedure 
for a fourth image interpolating method. 

<Best Mode for Carrying Out the Invention> 

Referring now to the drawings, embodiments of 
the present invention will be described. 
[1] Description of First Image Interpolating Method 
Referring now to Figs. 1 to 6, the outline of 
a first image interpolating method will be 
described. A two-dimensional image has a two- 
dimensional expanse in the horizontal direction and 
the vertical direction. In the schematic 
description of the first image interpolating method 
described below, however, a method of one- 
dimensional interpolation in the vertical direction 
will be described in order to simplify the 
description . 

Fig. 1 illustrates the relationship between 
original pixels and a pixel to be interpolated. 

In Fig. 1, lines (n-1) , n, (n+1) , and (n+2) are 
horizontal lines in an original image, and lines 
(i-1) , i, and (i + 1) are horizontal lines to be 



interpolated . 

Description is now made of a case where a pixel 
(hereinafter referred to as an interpolated pixel) 
X on the line i is interpolated. Let D12 be an 
original pixel just above the interpolated pixel X, 
and D22 be an original pixel just below the 
interpolated pixel X. Let Dll and D13 be 
respectively original pixels adjacent to the 
.'J original pixel D12. Let D21 and D23 be respectively 

is 

nj original pixels adjacent to the original pixel D22. 

!s ~ Further, let D02 be an original pixel just above the 

rU original pixel D 1 2 , and D32 be an original pixel just 

£3 below the original pixel D22. 

^ J In the following description, pixel data on the 

O original pixels Dll, D12, D 1 3 , D 2 1 , D 2 2 , D23, D02, 

and D32 and the interpolated pixel X are respectively 
denoted by dll, dl2, dl3, d21, d22, d23, d02, and 
d32 and x. In this example, the pixel data shall 
be composed of eight bits, black data shall be " 0 " , 
and white data shall be "255". 

Fig. 2 shows the procedure for finding the pixel 
data x on the interpolated pixel X by the first image 
interpolating method. 

First, an edge component E is calculated in 
order to judge whether or not the interpolated pixel 



X exists in the vicinity of an edge of an original 
image (step 1) . That is, the edge component E is 
found from the following equation (20) using the 
pixel data on the two original pixels D02 and D12 
just above the interpolated pixel X and the original 
pixels D22 and D23 just below the interpolated pixel 
X : 

E = -d02 + d!2 + d22 - d32 (20) 
=,3 When the interpolated pixel X exists in the 

rU vicinity of a black edge of the original image, the 

edge component E takes a relatively large negative 
l ^ value. When the interpolated pixel X exists in the 

^ vicinity of a white edge of the original image, the 

h ~ edge component E takes a relatively large positive 

:" = f ' value . 

A range where the pixel data x on the 
interpolated pixel X is settable is then determined 
(step 2) . That is, the range where the pixel data 
x on the interpolated pixel X is settable is 
determined, as shown in Fig. 3, on the basis of the 
edge component E found at the step 1. In Fig. 3, 
dmax denotes the larger one of the pixel data dl 2 and 
d22 on the original pixels D12 and D22, and d min 
denotes the smaller one of the pixel data dl 2 and 
d22 on the original pixels D12 and D22 . d denotes 
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the difference (d ma x-d min ) between the pixel data d 1 2 
and d22 on the original pixels D12 and D22 . 

Letting Th be a previously set threshold, the 
relationship between the edge component E and the 
range where the pixel data x on the interpolated 
pixel X is settable is as follows: 

• the range S where the pixel data x on the 
interpolated pixel X is settable when E > Th 

d min + (d/2 ) ^ S ^d m ax 

In this case, it is presumed that the 
interpolated pixel X exists in the vicinity of the 
white edge of the original image, and the settable 
range S is set to a range near d ma x in the range of 

dmin tO dmax* 

■ the range S where the pixel data x on the 
interpolated pixel X is settable when -Th ^ E ^ Th 

d mi n + (d/4) ^ S ^ d m ax ~ ( d / 4 ) 

• the range S where the pixel data x on the 
interpolated pixel X is settable when E < -Th 

d min ^ S ^ d min + (d/2) 

In this case, it is presumed that the 
interpolated pixel X exists in the vicinity of the 
black edge of the original image, and the settable 
range S is set to a range near d ma x in the range of 



Candidates for the pixel data on the 
interpolated pixel X are then found from the range 
S where the pixel data x on the interpolated pixel 
X is settable on the basis of pixel data on opposed 
pixels between which the interpolated pixel X is 
sandwiched diagonally (step 3). That is, the 
respective rainimums L m i n and Rmin of two diagonal 
correlation values L and R and pixel data xl and xr 
in a case where the minimums are respectively given 
are found from the range S where the pixel data x 
on the interpolated pixel X is settable, as described 
below . 

There are two methods of finding the candidates 
for the pixel data on the interpolated pixel X. The 
methods will be described. 

(1) Description of First Method 

All pixel data x in the settable range S are 
respectively substituted in the following equation 
(21) expressing a correlation value L between the 
pixel data on the two opposed pixels Dll and D23 
between which the interpolated pixel X is sandwiched 
diagonally (diagonally to the upper left) and the 
pixel data on the interpolated pixel X, to find the 
minimum correlation value L min and pixel data xl in 
a case where the minimum correlation value L m in is 



given : 

L = | dll-x | + | d 2 3 - x | **• (21) 

Similarly, all the pixel data x in the settable 
range S are respectively substituted in the 
following eguation (22) expressing a correlation 
value R between the pixel data on the two opposed 
pixels D13 and D21 between which the interpolated 
pixel X is sandwiched diagonally (diagonally to the 
upper right) and the pixel data on the interpolated 
pixel X, to find the minimum correlation value R m in 
and pixel data xr in a case where the minimum 
correlation value Rmin is given: 

R = | dl3-x| + Jd21-x| ••• (22) 

In such a manner, the found pixel data xl and 
xr are candidates for the pixel data on the 
interpolated pixel X. In such a method, however, 
a plurality of pixel data may, in some cases, be 
applicable as the pixel data xl in a case where the 
minimum correlation value Lm in is given. Similarly, 
a plurality of pixel data may, in some cases, be 
applicable as the pixel data xr in a case where the 
minimum correlation value Rmin is given. 

When a plurality of pixel data are applicable 
as the pixel data xl in a case where the minimum 
correlation value L min is given, the average of the 



pixel data may be determined as the pixel data xl 
in the case where the minimum correlation value L min 
is given. Similarly, when a plurality of pixel data 
are applicable as the pixel data xr in the case where 
the minimum correlation value R m in is given, the 
average of the pixel data may be determined as the 
pixel data xr in the case where the minimum 
correlation value R miI1 is given. 

(2) Description of Second Method 

Fig. 4 illustrates the relationship between the 
correlation value L and the pixel data x. In Fig. 
4, x m i n denotes the smaller one of the pixel data dll 
and d23 on the opposed pixels Dll and D23, and x max 
denotes the larger one of the pixel data dll and d23. 
xd denotes the difference ( x ma x ~ x m i n ) between the 
pixel data dll and d23. 

The foregoing equation (21) can be changed, as 
expressed by the following equations (23) , from the 
relationship between the correlation value L and the 
pixel data x shown in Fig. 4. 

L = xd + 2(x-x min ) (x > x max ) 

L = x d (x m i n = x=x max ) 

L = xd + 2(x m in-x) (x < x min ) *" (23) 

Although only equations for changing the 
correlation value L are shown, the correlation value 



R expressed by the foregoing equation (22) can be 
similarly changed. 

Description is now made of a method of finding 
minimum correlation values L min and Rmm and pixel 
data xl and xr (a second method) . Description is 
herein made of a method of finding the minimum 
correlation value L min and the pixel data xl. 

Figs. 5(a) to 5(f) show graphs of the 

'-^ correlation value L against the pixel data x and a 

f n 

range where the pixel data x is settable. 

In Fig. 5, xa denotes the minimum of the pixel 
i=i g data x in the settable range, and xb denotes the 

q. maximum of the pixel data x in the settable range. 

£J * i n t h e c a s e o f x b ^£ x m ± n 

Q When the range where the pixel data x is settable 

is not more than x min , as shown in Fig. 5 (a) , the 
correlation value L is the minimum in the pixel data 
xb . Accordingly, the minimum correlation value L min 
is xd + 2(x min -xb) . Further, the pixel data xl at 
this time is xb. 

in the case of x max ^ xa 
When the range where the pixel data x is settable 
is not less than x max , as shown in Fig. 5 (b) , the 
correlation value L is the minimum in the pixel data 
xa. Consequently, the minimum correlation value L min 
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is xd + 2(xa-x max ). Further, the pixel data xl at 
this time is x a . 

in the case of x min S xa and xb = x max 
When the range where the pixel data x is settable 
is between the pixel data x mitl and x max , as shown in 
Fig. 5 (c) , the correlation value L is the minimum 
xd in arbitrary pixel data x in the settable range. 
Consequently, the minimum correlation value L m±n is 
xd. In this case, a value (xa + xb) / 2 at the center 
of the settable range is determined as the pixel data 
xl . 

in the case of xa < x min and x ma x < xb 
When the range where the pixel data x is settable 
is a range wider than the range of the pixel data 
Xmin "to Xmax , as shown in Fig. 5 (d) , the correlation 
value L is the minimum xd in arbitrary pixel data 
x in the range of the pixel data x min to x max . 
Consequently, the minimum correlation value L m i n is 
xd. In this case, the average ( x min + x max ) / 2 of the 
pixel data x min and x max is determined as the pixel 
data x 1 . 

in the case of xa < x min and x min < xb ^ x m& x 
When the range where the pixel data x is settable 
is shifted leftward from the range of the pixel data 
x m i n "to x max , as shown in Fig. 5 (e) , the correlation 



value L is the minimum x d in arbitrary pixel data 
x in a range of the pixel data x min to xb . 
Consequently, the minimum correlation value L m i n is 
xd. In this case, the average ( x min + xb ) / 2 of the pixel 
data x min and xb is determined as the pixel data xl. 

in the case of x min ^ xa < x max and x max ^ xb 

When the range where the pixel data x is settable 
is shifted rightward from the range of the pixel data 
x m i n to Xm ax/ as shown in Fig. 5 (f) , the correlation 
value L is the minimum xd in arbitrary pixel data 
x in a range of the pixel data xa to x^a*. 
Consequently, the minimum correlation value L m i n is 
xd. In this case, the average ( x a + x max ) / 2 of the pixel 
data xa and x max is determined as the pixel data xl. 

The minimum correlation value L miri and the pixel 
data xl are thus found. The minimum correlation 
value Rmm and the pixel data xr are also found in 
the same manner as the minimum correlation value L m i n 
and the pixel data xl. 

When the minimum correlation values L min and R m in 
and the pixel data xl and xr in a case where the 
minimum correlation values are respectively given 
are found at the step 3, the pixel data corresponding 
to the smaller one of the minimum correlation value 
Lmin and Rmin is extracted (step 4) . 

4 0 



When the minimum correlation values L min and R min 
differ from each other, one pixel data is extracted. 
When the minimum correlation values L min and Rmin are 
the same, two pixel data are extracted. 

When one pixel data xl or xr is extracted at the 
step 4 (YES at step 5) , the extracted pixel data is 
determined as the pixel data x on the interpolated 
pixel X (step 6) . When two (a plurality of) pixel 
data xl and xr are selected at the step 4 (NO at step 
5) , the average of the pixel data xl and xr is 
determined as the pixel data x on the interpolated 
pixel X (step 7). 

The details are as follows: 

* if L min < Rmin, then X = xl 

• if L min > Rmin, then x = xr 

if L min = Rmin, then x = (xl+xr) / 2 
Although at the foregoing step 3, two sets are 
selected as the set of opposed pixels between which 
the interpolated pixel X is sandwiched diagonally, 
two or more sets may be selected. For example, six 
sets of opposed pixels, for example, Dll and D27, 
D12 and D26, D13 and D25 , D15 and D23, D16 and D22, 
and D17 and D21 may be selected, as shown in Fig. 
6. In this case, pixel data in a case where the 
minimum correlation value is given is found at the 



step 3 for each of the sets of opposed pixels. That 
is, six candidates for the pixel data are found. 

When the number of minimums of the minimum 
correlation values corresponding to the six sets of 
opposed pixels is three or more, three or more pixel 
data are extracted from the six candidates for the 
pixel data. 

When three or more pixel data are selected at 
the step 4, there are three methods, as described 
below, as a method of determining the pixel data x 
on the interpolated pixel X. 

The first method is one for calculating the 
average of three or more pixel data selected at the 
step 4 and determining the result of the calculation 
as the pixel data x on the interpolated pixel X. The 
second method is one for extracting the maximum and 
the minimum of three or more pixel data selected at 
the step 4 and calculating the average of the maximum 
and the minimum, and determining the result of the 
calculation as the pixel data x on the interpolated 
pixel X . 

The third method is one for selecting pixel data 
obtained from opposed pixels in closest proximity 
to the interpolated pixel X out of three or more pixel 
data selected at the step 4, and determining the 



selected pixel data as the pixel data x on the 
interpolated pixel X, When there exist two pixel 
data obtained from the opposed pixels in closest 
proximity to the interpolated pixel X, the average 
of the pixel data is calculated, and the result of 
the calculation is determined as the pixel data x 
on the interpolated pixel X. 

[1-1] Description of image Interpolating Device 
Using First Image Interpolating Method 
[1-1-1] Description of First Image Interpolating 
Device 

Although in the foregoing item [1] , description 
was made of the image interpolating method in a case 
where the number of sets of diagonally opposed pixels 
is set to two, description is herein made of a case 
where the number of sets of diagonally opposed pixels 
is six, as described using Fig. 6. Description is 
made of an image interpolating device for performing 
o n e - d i m e n s i o n a 1 interpolation in the vertical 
direction in order to simplify the description,. 

Fig. 7 illustrates the configuration of a first 
image interpolating device. 

A memory unit 1 stores pixel data on an original 
pixel inputted through an input terminal IN. A 
correlation value operating unit 2 uses the pixel 



data on the original pixel stored in the memory unit 
1, to calculate six minimum correlation values Ll m in 
to L3 min and Rlmin to R 3 m i n which are obtained from six 
sets of opposed pixels and pixel data xll to x31 and 
xlr to x3r in a case where the six minimum correlation 
values are respectively given. 

The minimum extracting unit 3 identifies the 
minimum correlation value which is the minimum of 
the six minimum correlation values Ll min to L3 m j. n and 
Rlmin to R3 min calculated by the correlation value 
operating unit 2. A pixel data selecting unit 4 
selects, out of the six pixel data xll to x31 and 
xlr to x3r which are fed from the correlation value 
operating unit 2 on the basis of the result of the 
identification in the minimum extracting unit 3, the 
pixel data which are candidates for pixel data on 
an interpolated pixel X. 

A ma x i mum / m i n i mum extracting unit 5 extracts 
the pixel data which are the maximum and the minimum 
of the pixel data selected by the pixel data 
selecting unit 4. An average operating unit 6 
calculates the average of the two pixel data 
extracted in the m a x i mum / m i n i mu m extracting unit h f 
and outputs the result of the calculation to an 
output terminal OUT as the pixel data on the 



interpolated pixel X. 

Description is made of the operation of the 
image interpolating device. 

Fig. 6 illustrates the relationship between 
original pixels and a pixel to be interpolated. 

As shown in Fig. 6, original pixels DO 4 , Dll to 
D17, D21 to D27, and D34 shall be arranged with 
respect to an interpolated pixel X. Pixel data on 
the interpolated pixel X and the original pixels D04 , 
Dll to D17, D21 to D27, and D34 shall be respectively 
denoted by x and d04, dll to dl7, d21 to d27, and 
d3 4 . 

First, the pixel data on the four original 
pixels D04, D14, D24, and D34 just above and just 
below the interpolated pixel X are inputted from the 
memory unit 1 to the correlation value operating unit 
2, where an edge component E is foundby the following 
equation (24) : 

E = -d04 + dl4 + d24 - d34 (24) 
By the edge component E thus found, a range S 
where the pixel data x on the interpolated pixel X 
is settable is found by the same method as that at 
the step 2 shown in Fig. 2. On the basis of the 
following equations (25) to (30) respectively 
expressing a correlation value LI between the pixel 



data on the opposed pixels Dll and D27 and the pixel 
data on the interpolated pixel X, a correlation value 
L2 between the pixel data on the opposed pixels D12 
and D26 and the pixel data on the interpolated pixel 
X, a correlation value L3 between the pixel data on 
the opposed pixels D13 and D25 and the pixel data 
on the interpolated pixel X, a correlation value Rl 
between the pixel data on the opposed pixels D17 and 
; ;3 D21 and the pixel data on the interpolated pixel S , 

a correlation value R2 between the pixel data on the 
opposed pixels D16 and D22 and the pixel data on the 
interpolated pixel X, and a correlation value R3 
r=t between the pixel data on the opposed pixels D 1 5 and 

ri D23 and the pixel data on the interpolated pixel X, 

the respective minimums Ll m i n to L3 min and Rlmin to R3 

m i n 

of the correlation values LI to L3 and Rl to R3 and 
pixel data xll to x31 and xlr to x3r in a case where 
the minimums are respectively given are found in the 
same method as that at the step 3 shown in Fig. 2. 



LI = (dll-x| + |d27-x| *" (25) 

L2 = [dl2-x| + |d26-x| ■•• (26) 

L3 - |dl3-x| + |d25-x| (27) 

Rl = |dl7-x| + |d21-x| (28) 

R2 = |dl6-x| + |d22-x| (29) 

R3 = |dl5-x| + |d23-x| — (30) 
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When the minimums Ll min to L3 min and Rl m in to R3 mill 
of the correlation values LI to L3 and Rl to R3 and 
the pixel data xll to x31 and xlr to x3r in a case 
where the minimums are respectively given are thus 
found by the correlation value operating unit 2, the 
minimums Ll min to L3 min and Rl min to R3 min are fed to 
the minimum extracting unit 3, and the pixel data 
xll to x31 and xlr to x3r are fed to the pixel data 
selecting unit 4. 

The minimum extracting unit 3 receives the 
minimum correlation values Ll min to L3 m i n and Rlmin to 
R3 min and outputs Flagl to Flag6 which are control 
signals respectively corresponding to the inputted 
minimum correlation values Ll min to L3 min and Rlmin to 

R 3 m i n • 

The minimum extracting unit 3 outputs the 
control signals Flagl to Flag6 respectively 
corresponding to the minimums Ll min to L3 m in and Rlmin 
to R3 m in of the correlation values LI to L3 and Rl 
to R3 . The control signal corresponding to the 
smallest one of the minimums Ll min to L3 m i n and Rlmin 
to R3 min of the correlation values Ll to L3 and Rl 
to R3 is considered to be High, and the control 
signals corresponding to the other minimums are 
considered to be Low. 



When Llmin and R2 min are the smallest of the 
minimums Ll min to L3 min and Rl m i n to R3 m i n , for example,, 
the control signals Flagl and FlagS are considered 
to be High, and the other control signals Flag2 to 
Flag4 and Flag6 are considered to be Low. The number 
of control signals which are High is not limited to 
two, as in this example. The number of control 
signals is any one of one to six. 

The control signals Flagl to Flag6 which are 
outputted from the minimum extracting unit 3 are fed 
to the pixel data selecting unit 4. In the pixel 
data selecting unit 4, the pixel data corresponding 
to the control signal which is High out of the control 
signals fed from the minimum extracting unit 3 is 
outputted to the m a x i mu m / m i n i m u m extracting unit 5. 

When the control signals Flagl and Flag5 fed 
from the minimum extracting unit 3 are High, and the 
other control signals Flag2 to Flag4 and Flag6 are 
Low, as in the above-mentioned example, the pixel 
data xll and x2r are selected and are fed to the 
m a x i mum / m i n i mu m extracting unit 5. 

In the ma x i mum / m i n i mum extracting unit 5, the 
maximum pixel data and the minimum pixel data are 
selected out of the pixel data fed from the pixel 
data selecting unit 4, and are fed to the average 
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operating unit 6. In the average operating unit 6, 
the average of the two pixel data fed from the 
maximum/minimum extracting unit 5 is calculated, and 
the result of the calculation is outputted to the 
output terminal OUT as the pixel data x on the 
interpolated pixel X. 

When only one of the pixel data is fed to the 
maximum/ minimum extracting unit 5, the 
m a x i m u m / m i n i m u m extracting unit 5 feeds the one 
pixel data to the average operating unit 6. In this 
case, the average operating unit 6 outputs the fed 
one pixel data as it is as the pixel data x on the 
interpolated pixel X. 

The pixel data on the original pixel is 
outputted to the output terminal OUT through the 
memory unit 1 and the correlation value operating 
unit 2 . That is, after the pixel data on the original 
pixel on the line n is outputted, the pixel data on 
the interpolated pixel on the line i is outputted. 

When a threshold Th for comparing edge 
components in the correlation value operating unit 
2 is made changeable in such a manner that it can 
be inputted from the exterior, an image to be 
reproduced can be subjected to most suitable 
interpolation processing. 



Although the first image interpolating device 
increases the number of lines, the same 
interpolation processing may be performed in the 
horizontal direction in order to increase the number 
of pixels on the line. 

When in Fig. 7, the m a x i mum / m i n i mu m extracting 
unit 5 and the average operating unit 6 are omitted, 
an average operating unit is provided in the 
succeeding stage of the pixel data selecting unit 
4, and a plurality of pixel data are selected by the 
pixel data selecting unit 4 P the average of the pixel 
data may be calculated, to output the result of the 
calculation to the output terminal OUT as the pixel 
data x on the interpolated pixel X. 

[1-1-2] Description of Second Image Interpolation 
Device 

Fig. 8 illustrates the configuration of a 
second image interpolating device. 

In Fig. 8, the same units as those shown in Fig. 
7 are assigned the same reference numerals and hence, 
the description thereof is not repeated. The 
relationship between an interpolated pixel X and 
original pixels shall be a relationship as shown in 
Fig. 6 . 

The image interpolating device comprises an 
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input terminal IN, an output terminal OUT, a memory 
unit 1, a correlation value operating unit 2, a 
minimum extracting unit 3, a pixel data selecting 
unit 4, and an interpolated pixel data extracting 
unit 7 for extracting pixel data found from opposed 
pixels in closest proximity to the interpolated 
pixel X out of pixel data fed from the pixel data 
selecting unit 4. 

The operations of the memory unit 1, the 
correlation value operating unit 2, the minimum 
extracting unit 3, and the pixel data selecting unit 
4 are the same as those of the memory unit 1, the 
correlation value operating unit 2, the minimum 
extracting unit 3, and the pixel data selecting unit 
4 show in Fig. 7. 

Minimum correlation values Ll min to L3 min and 
Rl min to R3 mln and pixel data xll to x31 and xlr to 
x3r are found in the correlation value operating unit 

2. The minimum correlation values Ll min to L3 min and 
Rl min to R3 m in are fed to the minimum extracting unit 

3, and the pixel data xll to x31 and xlr to x3r are 
fed to the pixel data selecting unit 4. 

Control signals Flagl to Flag6 respectively 
corresponding to the minimum correlation values 
Llmin to L3min and Rl m i n to R3 min are outputted from the 



minimum extracting unit 3. In the pixel data 
selecting unit 4, the pixel data corresponding to 
the control signal which is High is selected from 
the pixel data xll to x31 and xlr to x3r and is fed 
to the interpolated pixel data extracting unit 7. 

The interpolated pixel data extracting unit 7 
extracts the pixel data obtained from the set of 
opposed pixels in closest proximity to the 
interpolated pixel X out of the pixel data fed by 
the pixel data selecting unit 4, and outputs the 
pixel data to the output terminal OUT as pixel data 
x on the interpolated pixel X. In this case, when 
the number of extracted pixel data is two, the 
average of the pixel data is calculated, and the 
result of the calculation is outputted to the output 
terminal OUT as the pixel data x on the interpolated 
pixel X . 

When the pixel data selected by the pixel data 
selecting unit 4 are xll, x21, and xlr, for example, 
the pixel data obtained from the set of opposed 
pixels in closest proximity to the interpolated 
pixel X is the pixel data x21 obtained from opposed 
pixels D12 and D26. Accordingly, the pixel data x21 
is outputted to the output terminal OUT as the pixel 
data x on the interpolated pixel X. 



When the pixel data selected by the pixel data 
selecting unit 4 are xll, x21, and x2r, the pixel 
data obtained from the set of opposed pixels in 
closest proximity to the interpolated pixel X are 
the pixel data x21 obtained from the opposed pixels 
D12 and D26 and the pixel data x2r obtained from 
opposed pixels D 1 6 and D22. Accordingly, the average 
(x21+x2r)/2 of the pixel data x21 and x2r is 
outputted to the output terminal OUT as the pixel 
data x on the interpolated pixel X. 

The pixel data on the original pixel is 
outputted to the output terminal OUT through the 
memory unit 1 and the correlation value operating 
unit 2. That is, the pixel data on the original pixel 
on the line n is outputted, and the pixel data on 
the interpolated pixel on the line i is then 
outputted . 

The second image interpolating device 
increases the number of lines. In order to increase 
the number of pixels on the line, however, the same 
interpolation processing may be performed in the 
horizontal direction. 

In the first image interpolating method, after 
a range where the pixel data on the interpolated 
pixel is settable is determined on the basis of an 



edge component E, candidates for the pixel data on 
the interpolated pixel are extracted on the basis 
of diagonal correlation values. The advantage that 
the range where the pixel data on the interpolated 
pixel is settable is determined will be described 
using Fig. 9. In Fig. 9 , a black circle indicates 
an original pixel represented by black data, and a 
white circle indicates an original pixel represented 
by white data. X denotes the interpolated pixel. 
In the description of Fig. 9, the white data shall 
be and the black data shall be w 0 " in order to 

simplify the description. 

When there is a black thin line in a white 
background, as shown in Fig. 9 , it is preferable that 
the pixel data on the interpolated pixel X is taken 
as the black data "0". 

Description is made of a case where the 
candidates for the pixel data on the interpolated 
pixel are extracted on the basis of the diagonal 
correlation values without determining the range 
where the pixel data on the interpolated pixel is 
settable. In this case, the minimum of a correlation 
value ( | d 1 3 - x | + | d 2 5 - x | ) corresponding to opposed 
pixels D13 and D25 is I 1-1 | + I 1 -1 I = 0, and the pixel 
data x in a case where the minimum correlation value 



is given is 1- Further, the minimum of a correlation 
value ( | dl5-x | + |d23-x|) corresponding to opposed 
pixels D15 and D23 is | 0 - 0 | + I 0 - 0 | = 0, and the pixel 
data x in a case where the minimum correlation value 
is given is 0. Consequently, the pixel data x on 
the interpolated pixel X is ( 1 + 0 ) / 2 = 0.5, and is 
not black data. 

Description is made of a case where the range 
where the pixel data on the interpolated pixel is 
settable is determined as in the first image 
interpolating method, and the candidates for the 
pixel data on the interpolated pixel are extracted 
on the basis of diagonal correlation values. In this 
case, an edge component E (- -d04 + dl 4 + d24 - d34) 
is -1-1-0 + 1-1 = -1, and the range where the pixel 
data x on the interpolated pixel X is settable is 
0 < x ^0.5. 

When the minimum of a correlation value 
corresponding to the opposed pixels D13 and D25 is 
found in the settable range, |1-0.5| + |1-0.5| = 1, 
and the pixel data x in a case where the minimum 
correlation value is given is 0.5. Further, the 
minimum of a correlation value corresponding to the 
opposed pixels D15 and D23 is |0-0| + 10-01 = 0, and 
the pixel data x in a case where the minimum 



correlation value is given is 0. Consequently, the 
pixel data x on the interpolated pixel X is 0. 
[2] Description of Second Image Interpolating 
Method 

Description is made of a second image 
interpolating method. A two-dimensional image has 
two-dimensional expanse in the horizontal direction 
and the vertical direction. However, a method of 
one-dimensional interpolation in the vertical 
direction will be described in order to simplify the 
description . 

Fig. 10 shows the procedure for image 
interpolation processing by the second image 
interpolating method. 

Description is herein made of a method of 
finding pixel data on an interpolated pixel X on a 
line i between a line n and a line (n + 1) and between 
an original pixel D13 on the line n and an original 
pixel D23 on the line (n + 1) , as shown in Fig. 11. 

First, an edge component E is calculated in 
order to judge whether or not the interpolated pixel 
X exists in the vicinity of an edge of an original 
image (step 11) . That is, the edge component E is 
found from the following equation (31) using pixel 
data on two original pixels D03 and D13 just above 
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the interpolated pixel X and original pixels D 2 3 and 
D33 just below the interpolated pixel X: 

E = -d03 + dl3 + d23 - d33 ••• (31) 

It is then judged whether or not the edge 
component E is within a range of -Q ^ E ^ Q, letting 
N be a pseudo noise component previously set (step 
12) . The pseudo noise component Q is a variable which 
can be controlled from the exterior. 
=5 The edge component E is corrected on the basis 

;Jv of the result of the judgment. That is, letting El 

=*■ be an edge component after the correction, the edge 

i| component El after the correction is set to zero when 

3; the edge component E is within the range of - Q ^ E 

1 ^ Q (step 13) . 

J When the edge component E is outside the range 

of - Q ^ E ^ Q , that is, E < -Q or E > Q, the edge 
component El after the correction is set to E (step 
14) . 

Consequently, the relationship between the 
edge component E and the edge component El after the 
correction is expressed by the following equations 
32, and is expressed by a graph as shown in Fig. 12: 

El = 0 ( - Q ^ E ^ Q) 

El - E (E > Q or E < -Q) (32) 

The edge component E is thus corrected using the 
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pseudo noise component Q , thereby reducing the 
effect of noises appearing in the edge component E. 

A range S where pixel data x on the interpolated 
pixel X is settable is then determined on the basis 
of the edge component El after the correction (step 
15) . 

Description is made of a method of determining 
the settable range S on the basis of Fig. 13. In 
Fig. 13, d max denotes the larger one of pixel data 
dl 3 and d23 on the original pixels D13 and D23, and 
dmm denotes the smaller one of the pixel data dl 3 
and d23. dc denotes the average (d ma x "I" dmin 

)/2 Of dmax 

and dmin . 

(1) Range S Where Pixel Data x is Settable When 

E 1 ^ 0 

As shown in Fig. 13 (a) , d m in X a + dc X (1- 
a ) S S S d m ax X a + dc X < 1 - a ) + El X y, 
where a and y are variables which can be controlled 
from the exterior. 

That is, when the edge component El is not less 
than zero, the range S where the pixel data x is 
settable is a range expanded upward by the value of 
y -El from a range centered around dc [ d min X a + 
dc X (1-a) < x ^ d max X a + dc X ( 1 - a ) ] . 

(2) Range S Where Pixel Data x is Settable When 
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E 1< 0 

As shown in Fig. 13 (b) , d rain X a + dc X (1- 
a) + El X y ^ s ^ dmax X a + dc X ( 1 - a ) . 

That is, when the edge component El is less than 
zero, the range S where the pixel data x is settable 
is a range expanded downward by the value of y -El 
from a range centered around dc [d min X a + dc X 
( 1 - a ) ^ x S d max X a + dc X ( 1 - a ) ] . 

Candidates for the pixel data on the 
interpolated pixel X are then found from the range 
S where the pixel data x on the interpolated pixel 
X is settable on the basis of pixel data on opposed 
pixels between which the interpolated pixel X is 
sandwiched diagonally (step 16) . 

Although a method of finding the candidates for 
the pixel data on the interpolated pixel X is 
approximately the same as that at the step 3 shown 
in Fig. 2, equations for finding correlation values 
L and R differ from those at the step 3 shown in Fig. 
2 . 

A correlation value L between pixel data on 
opposed pixels D12 and D24 and the pixel data on the 
interpolated pixel X is expressed by the following 
equation (33) , and a correlation value R between 
pixel data on opposed pixels D14 and D22 and the pixel 



data on the interpolated pixel X is expressed by the 
following equation (34) : 

L - |dl2-x| + |d24-x| + j3 1 X HI - j82 X VI 

- (33) 

R = |dl4-x| + | d22-x | + j8 1 X Hr - j3 2 X Vr 

(34) 

In the foregoing equation (33) and (34) , 0 1 and 
j3 2 are variables which can be controlled from the 
exterior . 

HI denotes the larger one of an amount of change 
Hll of amounts dll to dl3 found by the following 
equation (35) and an amount of change H12 of amounts 
d23 to d25 found by the following equation (36) . That 
is, HI = MAX (Hll, H12) . MAX ( a , b) is a sign 
indicating that the larger one of a and b is selected. 

VI denotes the smaller one of an amount of change 
Vll of d02 to d22 found by the following equation 
(37) and an amount of change V12 of dl 4 to d34 found 
by the following equation (38) . That is, VI = 
MIN(V11, V12) . MIN(a, b) is a sign indicating that 
the smaller one of a and b is selected . 

Hll = |dll-dl2| + |dl2-dl3f ••• (35) 
H12 = |d23-d24[ + |d24-d251 ■■• (36) 

VII - |d02-dl2i + (dl2-d22| "* (37) 
V12 - |dl4-d24| + |d24-d34| ••• (38) 
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Hr denotes the larger one of an amount of change 
Hr of d 1 3 to d 1 5 found by the following equation (39) 
and an amount of change Hr2 of d21 to d23 found by 
the following equation (40) . That is, Hr = MAX ( Hr 1 , 
Hr 2 ) . 

Vr denotes the smaller one of an amount of change 
Vrl of dl2 to d32 found by the following equation 
(41) and an amount of change Vr2 of dO 4 to d24 found 
by the following equation (42) . That is, Vr = 
M I N (Vrl , Vr 2 ) . 

Hrl = |dl3-dl4 | + | dl4-dl5 | (39) 
Hr2 = |d21-d22 | + |d22-d23| (40) 
Vrl = | dl2-d22 | + |d22-d32| (41) 
Vr2 = | d04-dl4 | + |dl4-d24| (42) 
Fig. 14 illustrates the relationship between 
the correlation value L and the pixel data x. In 
Fig. 14, x m i n denotes the smaller one of the pixel 
data dl2 and d24, and x max denotes the larger one of 
the pixel data dl 2 and d24. Further, xd = x max - x min 
+ jSl X HI - jS2 Xvl. 

When xd = x max - x min + j3lXHl-j32Xvi, the 
correlation value L expressed by the foregoing 
equation (33) can be changed, as in the following 
equations (43) . The correlation value R can be 
similarly changed: 



L = xd + 2(x min -x) (x < x mi n) *" (43) 

Minimum correlation values L min and Rmin and 
pixel data xl and xr can be found in the method 
described in the second method at the step 3 shown 
in Fig. 2, that is, the same method as the method 
described using Fig. 5. In this case, xd in the graph 
shown in Fig. 5 indicates x max - x min + £ 1 X HI- /3 
2 X VI . 

When the minimum correlation values Lm in and Rmin 
and the pixel data xl and xr in a case where the 
minimum correlation values are respectively given 
are found at the step 16, the pixel data 
corresponding to the smaller one of the minimum 
correlation values L min and R min is extracted (step 
17). 

When the minimum correlation values L min and Rmin 
differ from each other, one pixel data is extracted. 
When the minimum correlation values L m i n and R m m are 
the same, two pixel data are extracted. 

When one pixel data xl or xr is extracted at the 
step 17 (YES at step 18) , the extracted pixel data 
is determined as the pixel data x on the interpolated 
pixel X (step 19) . When two (a plurality of) pixel 
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data xl and xr are selected at the step 17 (NO at 
step 18) , the average of the pixel data xl and xr 
is determined as the pixel data x on the interpolated 
pixel X (step 2 0). 

Although description was made of the image 
interpolating method using a case where there are 
two sets of opposed pixels, the number of sets of 
opposed pixels may be two or more. 

In the image interpolating device configured as 
shown in Fig. 7 or 8, when image interpolation is 
performed using the second image interpolating 
method, the correlation value operating unit 2 may 
be caused to perform the processing at the steps 11 
to 16 shown in Fig. 10. 

Description is now made of the operation of the 
correlation value operating unit 2 in a case where 
pixel data x on an interpolated pixel X shown in Fig. 
15 is found. Further, description is made of a case 
where the number of sets of diagonally opposed pixels 
is six. 

The correlation value operating unit 2 first 
finds an edge component E on the basis of the 
following equation (44) , as described at the step 
11 shown in Fig. 10: 

E = -d05 + dl5 + d25 - d3 5 ••• (4 4 ) 



An edge component El whose effect of a noise 
component has been reduced is then found on the basis 
of the edge component E, as described at the steps 
12 to 14 shown in Fig. 10. That is, the edge component 
El after the correction is corrected on the basis 
of the following equations (45) : 

El = 0 (-Q^E^Q) 

El = E (E > Q or E < -Q) (45) 

A range S where the pixel data x on the 
interpolated pixel X is settable is then found, as 
described at the step 15 shown in Fig. 10, by the 
edge component El thus found. 

Candidates for the pixel data on the 
interpolated pixel X are then found in the same 
method as that described at the step 16 shown in Fig. 
10. In this example, the number of sets of opposed 
pixels between which the interpolated pixel X is 
sandwiched diagonally is six. 

On the basis of the following equations (46) to 
(51) respectively expressing a correlation value LI 
between pixel data on opposed pixels D12 and D28 and 
the pixel data on the interpolated pixel X, a 
correlation value L2 between pixel data on opposed 
pixels D13 and D27 and the pixel data on the 
interpolated pixel X, a correlation value L 3 between 
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pixel data on opposed pixels D14 and D26 and the pixel 
data on the interpolated pixel X, a correlation value 
Rl between pixel data on opposed pixels D18 and D26 
and the pixel data on the interpolated pixel X, a 
correlation value R2 between pixel data on opposed 
pixels D17 and D23 and the pixel data on the 
interpolated pixel X, and a correlation value R3 
between pixel data on opposed pixels D16 and D24 and 
the pixel data on the interpolated pixel, the 
respective minimums Ll m i n to L3 m i n and Rlmin to R3 m i n 
of the correlation values LI to L3 and Rl to R3 and 
pixel data xll to x31 and xlr to x3r in a case where 
the minimums are respectively given are found: 

LI = |dl2-x| + |d28-x| + j3l X Hla - j3 2 X Via 

— (46) 

L2 = |dl3-x| + |d27-x| + )3l X Hlb - jS 2 X Vlb 

- (47) 

L3 - |dl4-x| + |d26-x| + j3 1 X Hlc - & 2 X Vic 

(48) 

Rl = |dl8-x| + |d22-x| + j3 1 X Hra - j3 2 X Vra 

... (49) 

R2 - |dl7-x| + |d23-x| + j3 1 X Hrb - $2 X Vrb 

- (50) 

R3 = |dl6-x| + |d24-x| + j3 1 X Hrc - j3 2 X Vrc 

- (51) 



Hla to Hlc, Hra to Hrc, Via to Vic, and Vra to 

Vrc in the foregoing equations (46) to (51) are 
expressed by the following equations (52) to (63) ; 

Hla = MAX ( H 1 a 1 , Hla2) (52) 

Hlb = MAX (Hlbl f Hlb2) ••- (53) 

Hlc = MAX(Hlcl, Hlc2) "* (54) 

Hra - MAX ( H r a 1 , Hra2) ■■■ (55) 

Hrb = MAX (Hrbl f Hrb2) "* (56) 

Hrc = MAX(Hrcl, Hrc2) (57) 

Via = MIN(Vlal, Vla2) ••■ (58) 

Vlb = MIN(Vlbl, Vlb2) *** (59) 

Vic = MIN(Vlcl, Vlc2) (60) 

Vra = MIN(Vral, Vra2) *•• (61) 

Vrb = MIN(Vrbl, Vrb2) ■•• (62) 

Vrc = MIN(Vrcl f Vrc2) *•• (63) 

Furthermore, Hlal to Hlcl, Hla2 to Hlc2, Hral 
to Hrcl, Hra2 to Hrc2, Vial to Vlcl, Vla2 to Vlc2, 

Vral to Vrc2, and Vra2 to Vrc2 in the foregoing 
equations (52) to (63) are expressed by the following 
equations (64) to (87) : 



Hlal = | dl 1 -dl 2 

Hlbl = | dl 2 -dl 3 

Hlcl = | dl 3 -dl 4 

Hla2 = | d27 - d 2 8 

Hlb2 = |d26-d27 



+ | dl2-dl3 I (64) 

+ | dl 3 -dl 4 | (65) 

+ | dl 4 -dl 5 | (66) 

+ |d28-d29| ••• (67) 

+ | d 2 7 - d 2 8 | ■•■ (68) 





H 1 c 2 


- 


| d2 5 - d2 6 1 


+ 


| d2 6 -d2 7 | 


•■• (69) 




H r a 1 


= 


1 dl 7 -dl 8 | 


+ 


| dl 8 -dl 9 | 


- (70) 




Hr b 1 




| dl 6 -dl 7 | 


+ 


| dl 7-dl 8 | 


(71) 




H r c 1 




| d 1 5 -dl 6 | 


+ 


| dl 6 -dl 7 | 


- (72) 




H r a 2 


= 


| d2 1 -d2 2 1 


+ 


1 d2 2 -d2 3 | 


(73) 




Hr b 2 




1 d2 2 -d2 3 | 


+ 


| d2 3 -d2 4 | 


••• (74) 




H r c 2 




1 d2 3 -d2 4 | 


+ 


| d2 4 -d2 5 | 


*" (75) 




Vial 




| dO 2-dl 2 | 


+ 


| dl2-d22 | 


(76) 


3 - 


Vlb 1 


= 


| dO 3 -dl 3 | 


+ 


| dl3-d23 


(77) 


□ $ 

: f 

^ w 


VI c 1 




| dO 4-dl 4 | 


+ 


| dl 4 -d2 4 


(78) 




V 1 a 2 


= 


| dl 8 -d2 8 S 


+ 


| d2 8 -d3 8 


- (79) 


u 


Vlb 2 


= 


| dl 7 -d2 7 | 


+ 


| d2 7-d3 7 


(80) 




V 1 c 2 


= 


| dl 6 -d2 6 i 


+ 


| d2 6 - d3 6 


I - (81) 




Vr a 1 


- 


| dO 8 -dl 8 | 


+ 


| dl 8 -d2 8 


I - (82) 


3 


Vr b 1 


= 


| dO 7 -dl 7 


+ 


| dl 7 -d2 7 


I - (83) 




V r c 1 




| dO 6 - dl 6 


+ 


| dl 6 -d2 6 


| - (84) 




V r a 2 




i dl 2 - d 2 2 


+ 


| d2 2 -d3 2 


1 *•* (85) 




Vrb2 




| dl 3 -d2 3 


+ 


| d2 3 -d3 3 


I - (86) 




V r c 2 




| dl 4 -d2 4 


| + 


| d2 4 -d3 4 


I - (87) 




When 


the minimum 


cor 


relation 


values LI 




L3 min and 


Rlmin tO R3 niin 


and 


the pixel 


data x 1 1 



and xlr to x3r in a case where the minimums are 
respectively given are thus found in the correlation 
value operating unit 2, the minimum correlation 
values Ll min to L3 min and Rl min to R3 min are fed to the 
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minimum extracting unit 3, and the pixel data xll 
to x31 and xlr to x3r are fed to the pixel data 
selecting unit 4. 

A method of determining the settable range S at 
the step 15 shown in Fig. 10 differs from the method 
of determining the settable range S at the step 2 
shown in Fig. 2. The advantage of the method of 
determining the settable range S at the step 15 shown 
in Fig. 10 will be described using Fig. 16. 

In Fig. 16, a black circle, a white circle, a 
hatched circle respectively indicate an original 
pixel represented by black data, an original pixel 
represented by white data, and a gray original pixel. 
X denotes an interpolated pixel. In the description 
of Fig. 16, the white data shall be w 1 " , the black 
data shall be "0", and the gray data shall be "0.5" 
in order to simplify description. 

As shown in Fig. 16, there is a case where there 
are two black lines in a white background, and their 
boundary is gray. In such a case, it is preferable 
that pixel data on a pixel X to be interpolated 
between gray pixels in the boundary is the black data 
w 0 " . 

Description is made of a case where the pixel 
data on the interpolated pixel X is found by the first 
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image interpolating method. In this case, an edge 
component E (= -d04 + d 1 4 + d24 - d34) is -1 + 0.5 
+ 0.5 -1 = -1, and a range S where the pixel data 
x on the interpolated pixel X is settable is 0.5. 
Consequently, the pixel data x on the interpolated 
pixel X is 0.5, and is not black data. 

Description is made of a case where the pixel 
data on the interpolated pixel X is found, as in the 
second image interpolating method. Also in this 
case, an edge component E (= -d04 + d!4 + d24 - d34) 
is - 1 + 0.5 + 0.5 - 1 = -1- Further, El - -1. 

Since El < 0, the range S where the pixel data 
x on the interpolated pixel X is settable is d min X 
a + dcX (1-a) + El X y ^ S ^ d ma x X a + dc X (1- 
a) . For convenience of illustration, when a = 1 
and y = 0.5, the settable range S is d min + El X 0.5 
^ S ^ d m ax. That is, 0.5 - 0.5 ^ S ^ 0.5, i.e., 

0 ^ S ^ 0.5. 

For convenience of illustration, when the 
minimum of the correlation values corresponding to 
opposed pixels D13 and D25 is found within the 
settable range S, considering & in the equations 
(46) to (51) for finding the correlation values to 
be zero, |1-0.5| + |1-0.5| - 1, and the pixel data 
x in a case where the minimum correlation value is 



given is 0.5. Further, the minimum of the 
correlation values corresponding to opposed pixels 
D15 and D23 is | 0 — 0 I + I 0 — 0 | = 0, and the pixel 
data x in a case where the minimum correlation value 
is given is zero. Consequently, the pixel data x 
on the interpolated pixel X is zero. 

A correlation value calculating equation used 
at the step 16 shown in Fig. 10 and the correlation 
value calculating equation used at the step 3 shown 
in Fig. 2 differ from each other. The advantage of 
the correlation value calculating equation used at 
the step 16 shown in Fig. 16 will be described using 
Fig. 17. 

In Fig. 17, a black circle and a white circle 
respectively indicate an original pixel represented 
by black data and an original pixel represented by 
white data. X denotes an interpolated pixel. In 
the description of Fig. 17, the white data shall be 
-1", the black data shall be "0", and gray data shall 
be "0.5" in order to simplify the description. 

As shown in Fig. 17, in a case where there is 
a black line in a white background, when the pixel 
X is interpolated between an original pixel D14 and 
an original pixel D24, pixel data on the interpolated 
pixel X is made larger than the pixel data on the 
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interpolated pixel between an original pixel D13 and 
an original pixel D23, so that the thickness of the 
line is changed in the first image interpolating 
method . 

In such a case, when the correlation value is 
found in consideration with the connection with 
pixels in the vicinity of the opposed pixels as in 
the second image interpolating method, the pixel 
data on the interpolated pixel X between the original 
pixel D14 and the original pixel D24 can be made equal 
to the pixel data on the interpolated pixel between 
the original pixel D13 and the original pixel D23. 
[3] Description of Third Image Interpolating Method 

Description is now made of a third image 
interpolating method. 

Fig. 18 illustrates the relationship between 
original pixels and a pixel to be interpolated. 

In the third image interpolating method, a 
pixel is interpolated at a central position among 
four original pixels D12 , D13 , D22 f and D2 3 , as shown 
in Fig. 18. 

Description is now made of a method of finding 
pixel data on an interpolated pixel X arranged at 
the central position among the four original pixels 
D12 , D 1 3 , D 2 2 , and D23. 



Pixel data on original pixels D01 to DO 4 , Dll 
to D14, D21 to D24 , and D31 to D34 and the pixel data 
on the interpolated pixel X are respectively denoted 
by dOl to d04, dll to dl4, d 2 1 to d24, and d31 to 
d3 4 and x . 

Fig. 19 shows the procedure for image 
interpolation processing by the third image 
interpolating method. 

First, two types of edge components EL and ER 
are calculated in order to judge whether or not the 
interpolated pixel X exists in the vicinity of an 
edge of an original image (step 31) . That is, the 
edge component EL is calculated on the basis of the 
following equation (88) using the pixel data on the 
original pixels DOl, D12 , D23, and D34, and the edge 
component ER is calculated on the basis of the 
following equation (89) using the pixel data on the 
original pixels D04, D13, D22 f and D31: 

EL = -dOl + dl2 + d23 - d34 (88) 

ER = -d04 + dl3 + d22 - d31 — (89) 

Ranges SL and SR where the pixel data x on the 
interpolated pixel X is settable are then determined 
for the edge components EL and ER (step 32) . 

That is, the range SL where the pixel data x on 
the interpolated pixel X is settable is found on the 



basis of the edge component EL, and the range SR where 
the pixel data x on the interpolated pixel X is 
settable is found on the basis of the edge component 
ER, as at the step 2 shown in Fig. 2. 

Specifically, letting Th be a predetermined 
threshold, dL max be the larger one of the pixel data 
dl2 on the original pixel D12 and the pixel data d23 
on the original pixel D23, dL min be the smaller one 
of the pixel data dl2 and d23 f and dL be dL max -dL min , 
the settable range SL is found on the basis of the 
following expression (90) : 

if EL > Th, then dL min + dL/2 ^ SL ^ dL ma *, 
if -Th ^ EL ^ Th, then dL min + dL/4 ^ SL ^ dL max 

- dL/4, and 

if E < -Th, then dL min ^ SL ^ dL min + dL/2 

— (90) 

Letting dR max be the larger one of the pixel data 
dl3 on the original pixel D13 and the pixel data d22 
on the original pixel D22, dR min be the smaller one 
of the pixel data dl3 and d22, and dR be d R ma x - d R mi n , 
the settable range SR is found on the basis of the 
following expression (91) : 

if ER > Th, then dR m in + dR/2 ^ SR ^ dR max , 
if -Th ^ ER ^ Th, then dR min + dR/4 ^ SR ^ dR ma x 

- dR/4, and 
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if ER < -Th r then dR min ^ SR ^ dR mi n + dR/2 

— (91) 

It is then judged whether or not there exist 
portions which are overlapped with each other in both 
the settable ranges SL and SR (step 33) . 

When there are portions which are overlapped 
with each other in both the settable ranges SL and 
SR, as shown in Fig. 20 (a) , the overlapped portions 
are taken as a range S where the pixel data x on the 
interpolated pixel X is settable (step 34). 

Candidates for the pixel data on the 
interpolated pixel X are found from the range where 
the pixel data x on the interpolated pixel X is 
settable on the basis of pixel data on opposed pixels 
between which the interpolated pixel X is sandwiched 
diagonally (step 35) . 

On the basis of the following equations (92) to 
(97) respectively expressing a correlation value Ll 
between the pixel data on the original pixels Dll 
and D24 and the pixel data on the interpolated pixel 
X, a correlation value L2 between the pixel data on 
the original pixels D 1 2 and D23 and the pixel data 
on the interpolated pixel X, a correlation value L 3 
between the pixel data on the original pixels D02 
and D33 and the pixel data on the interpolated pixel 



X, a correlation value Rl between the pixel data on 
the original pixels D14 and D21 and the pixel data 
on the interpolated pixel X, a correlation value R2 
between the pixel data on the original pixels D13 
and D22 and the pixel data on the interpolated pixel 
X, and a correlation value R3 between the pixel data 
on the original pixels D03 and D32 and the pixel data 
on the interpolated pixel X, the respective minimums 
□ - Ll min to L3 min and Rl min to R3 min of the correlation 

=3 

Si > values Li to L3 and Rl to R3 and pixel data xll to 

!•* x31 and x i r to x3r in a case where the minimums are 

respectively given are found in the same method as 
the second method at the step 3 shown in Fig. 2: 
LI = | dll-x I + I d24-x | (92) 
L2 - | dl 2 - x | + | d2 3 -x | (93) 
L3 - | dO 2 - x | + | d3 3 - x | (94) 
Rl = |dl4-x| + |d21-x[ (95) 
R2 - | dl 3 - x | + | d2 2 - x | (96) 
R3 = |d03-x| + |d32-x| •** (97) 

The minimum correlation value which is the 
minimum of the minimum correlation values Ll min to 
L3 min and Rl min to R3 min thus found is selected, and 
the pixel data corresponding to the selected minimum 
correlation value is extracted from the pixel data 
xll to x31 and xlr to x3r (step 36) . 
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The pixel data x on the interpolated pixel X is 
found on the basis of the pixel data extracted at 
the step 36 (step 37) . 

That is, the pixel data and the pixel data which 
are respectively the maximum and the minimum are 
extracted from the pixel data extracted at the step 
36, and the average of the two pixel data is then 
calculated. The result of the calculation is taken 
3 - as the pixel data x on the interpolated pixel X. When 

i 

the number of the pixel data selected at the step 
36 is one, the pixel data is determined as the pixel 
data x on the interpolated pixel X. 

The average of the pixel data extracted at the 
step 36 may be calculated, to determine the result 
of the calculation as the pixel data x on the 
interpolated pixel X. 

Pixel data obtained from opposed pixels in 
closest proximity to the interpolated pixel X may 
be extracted from the pixel data selected at the step 
36, to take the extracted pixel data as the pixel 
data x on the interpolated pixel X. In this case, 
when there are two pixel data obtained from the set 
of opposed pixels in closest proximity to the 
interpolated pixel X, the average of the pixel data 
is taken as the pixel data x on the interpolated pixel 
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X . 

When it is judged at the foregoing step 33 that 
the settable ranges SL and SR respectively found by 
the edge components EL and the ER are not overlapped 
with each other, as shown in Fig. 20 (b) f the average 
(dl2+dl3+d22+d23)/4 of the pixel data dl 2 , dl 3 , d2 2 , 
and d23 on the four original pixels D 1 2 , Dl 3 , D 2 2 , 
and D23 is determined as the pixel data x on the 

a 

' interpolated pixel X (step 38). 

:a 

= jj ' When image interpolation is performed using the 

third image interpolating method in the image 

: : I 

U interpolating device configured as shown in Figs. 

7 and 8 r the correlation value operating unit 2 may 
be caused to perform the processing at the steps 31 

~ to 35 and the step 38 shown in Fig. 19. 

That is, the correlation value operating unit 
2 first finds the edge components EL and ER, and finds 
the settable ranges SL and SR for the found edge 
components EL and ER. When there are portions which 
are overlapped with each other in the settable ranges 
SL and SR, the minimum correlation values Ll min to 
L3 min and Rl m in to R3 min and the pixel data xll to x31 
and xlr to x3r in a case where the minimum correlation 
values are respectively given are thus found. The 
found minimum correlation values Ll min to L3 m in and 
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Rlmm to R3 min are fed to the minimum extracting unit 
3 r and the pixel data xll to x31 and xlr to x3r are 
fed to the pixel data selecting unit 4. 

On the other hand, when the settable ranges SL 
and SR found by the edge components El and ER are 
not overlapped with each other, the average of the 
pixel data on the four pixels D12, D13, D22, and D23 
is outputted to the output terminal OUT as the pixel 
data x on the interpolated pixel X. 

Although in the above-mentioned example, the 
pixel data on the interpolated pixel is found using 
six sets of opposed pixels, the number of sets of 
opposed pixels is not limited to six. The pixel data 
on the interpolated pixel may be found using more 
sets of opposed pixels. 

[4] Description of Fourth Image Interpolating Method 

Description is now made of a fourth image 
interpolating method. 

In the fourth image interpolating method, a 
pixel is interpolated at a central position among 
four original pixels D 1 2 , D 1 3 , D22, and D23, as shown 
in Fig, 18, as in the third image interpolating 
method. However, the fourth image interpolating 
method slightly differs from the third image 
interpolating method. 
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Description is now made of a method of finding 
pixel data on an interpolated pixel arranged at the 
central position among the fourth original pixels 
D12, D13, and D22, and D23. 

Pixel data on original pixels D01 to DO 4 , Dll 
to D14, D21 to D24 , and D31 to D34 and the pixel data 
on the interpolated pixel X are respectively denoted 
by dOl to d04, dll to dl4, d 2 1 to d24, and d31 to 
d 3 4 and x . 

Fig. 21 shows the procedure for image 
interpolation processing by the fourth image 
interpolating method. 

First, two types of edge components EL and ER 
are calculated in order to judge whether or not the 
interpolated pixel X exists in the vicinity of an 
edge of an original image (step 41) . That is, the 
edge component EL is calculated on the basis of the 
following equation (98) using the pixel data on the 
original pixels DOl, D12 , D23, and D 3 4 , and the edge 
component ER is calculated on the basis of the 
following equation (99) using the pixel data on the 
original pixels D04, D13, D22, and D31: 

EL = -dOl + dl2 + d23 - d34 (98) 

ER = -d04 + dl3 + d22 - d31 ■•• (99) 

Correction processing is then performed with 
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respect to the edge component EL. That is, it is 
judged whether or not the edge component EL is within 
a range of -Q ^ EL ^ Q, letting N be a pseudo noise 
component previously set (step 42) . 

The edge component EL is corrected on the basis 
of the result of the judgment. That is, letting ELI 
be an edge component after the correction, the edge 
component ELI after the correction is set to zero 
when the edge component EL is within the range of 
- Q S EL ^ Q ( step 43 ) . 

When the edge component ER is outside the range 
of -Q ^ EL S Q, that is, EL < -Q or EL > Q, the edge 
component El after the correction is taken as EL 
(step 44). 

Similar correction processing is then also 
performed with respect to the edge component ER. 
That is, it is judged whether or not the edge 
component ER is within the range of -Q ^ ER Q, 
letting N be a pseudo noise component previously set 
(step 45), 

The edge component ER is corrected on the basis 
of the result of the judgment. That is, letting ER1 
be an edge component after the correction, the edge 
component ERl after the correction is set to zero 
when the edge component EL is within the range of 
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-q <: ER ^ Q (step 46). 

When the edge component ER is outside the range 
of -Q ^ ER ^ Q, that is, ER < -Q or ER > Q, the edge 
component ER1 after the correction is taken as ER 
(step 4 7). 

A range SL where the pixel data x on the 
interpolated pixel X is settable is then determined 
on the basis of ELI after the correction, and a range 
SR where the pixel data x on the interpolated pixel 
X is settable is then determined on the basis of ER1 
after the correction (step 48) . A method of finding 
the settable ranges SL and SR is the same as that 
at the step 15 shown in Fig. 10. 

Specifically, letting dL ma x be the larger one 
of the pixel data dl2 on the original pixel D12 and 
the pixel data d23 on the original pixel D23, dL min 
be the smaller one of them, dLc be the average of 
dL m ax and dL min , and a and y be previously set factors, 
the settable range SL is found on the basis of the 
following expression (100) : 

if ELI ^ 0, then dL min • a + dL c ( 1 - a ) ^ SL ^ dL mdX - 
a + dLc(l-a) + ELI • 7 , and 

if ELI < 0, then dL mia -a + dLc(l-a) + ELI - 7 = 
SL^ dL max -a + dLc(l-a) (100) 

Letting dR max be the larger one of the pixel data 
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dl3 on the original pixel D13 and the pixel data d22 
on the original pixel D 2 2 , dR mi n be the smaller one 
of them, dRc be the average of dR ma x and dR^m, and 
a and y be previously set factors, the settable 
range SR is found on the basis of the following 
expressions (101) : 

if ER1 ^ 0, then dR min • a + dRc ( 1 - a ) ^ SR ^ dR max - 
a + dRc ( 1 - a ) + ER1 ■ y , and 

if ER1 < 0, then dR min ■ os + dRc(l-a) + E R 1 * y ^ 
SR^ dR max *a + dRc(l-a) (101) 

It is then judged whether or not there are 
portions which are overlapped with each other in both 
the settable ranges SL and SR (step 49) . 

When there are portions which are overlapped 
with each other in both the settable ranges SL and 
SR, the overlapped portions are taken as a range S 
where the pixel data x on the interpolated pixel X 
is settable (step 50). 

Candidates for the pixel data on the 
interpolated pixel X are found from the range where 
the pixel data x on the interpolated pixel X is 
settable on the basis of pixel data on o p p o s e d p i x e 1 s 
between which the interpolated pixel X is sandwiched 
diagonally (step 51) . 

On the basis of the following equations (102) 
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to (107) respectively expressing a correlation value 
LI between the pixel data on the original pixels Dll 
and D24 and the pixel data on the interpolated pixel 
X, a correlation value L2 between the pixel data on 
the original pixels D12 and D23 and the pixel data 
on the interpolated pixel X f a correlation value L3 
between the pixel data on the original pixels D02 
and D33 and the pixel data on the interpolated pixel 
X, a correlation value Rl between the pixel data on 
the original pixels D14 and D21 and the pixel data 
on the interpolated pixel X, a correlation value R2 
between the pixel data on the original pixels D13 
and D22 and the pixel data on the interpolated pixel 
X, and a correlation value R3 between the pixel data 
on the original pixels D03 and D32 and the pixel data 
on the interpolated pixel X, the respective minimums 
Ll min to L3 min and Rl min to R3 min of the correlation 
values LI to L3 and Rl to R3 and pixel data xll to 
x3 1 and xlr to x3r in a case where the minimums are 
respectively given are found in the same method as 
the second method at the step 3 shown in Fig. 2: 
LI = | dll-x | + | d24-x | '*• (102) 
L2 = |dl2-x| + Id23-x| ••• (103) 
L3 = | d02-x | + |d33-xj (104) 
Rl - |dl4-x| + |d21-x| — (105) 
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R2 - |dl3-x| + |d22-x| (106) 

R3 - [d03-x| + |d32-x| (107) 

The minimum correlation value which is the 
minimum of the minimum correlation values Ll mi n to 
L3 min and Rlmm to R3 min thus found is selected, and 
the pixel data corresponding to the selected minimum 
correlation value is extracted from the pixel data 
xll to x31 and xlr to x3r (step 52) . 

The pixel data x on the interpolated pixel X is 
found on the basis of the pixel data extracted at 
the step 52 (step 53) . 

That is, the pixel data and the pixel data which 
are respectively the maximum and the minimum are 
extracted from the pixel data extracted at the step 
52, and the average of the two pixel data is then 
calculated. The result of the calculation is taken 
as the pixel data x on the interpolated pixel X. When 
the number of pixel data extracted at the step 52 
is one, the pixel data is determined as the pixel 
data x on the interpolated pixel X. 

The average of the pixel data extracted at the 
step 52 may be calculated, to determine the result 
of the calculation as the pixel data x on the 
interpolated pixel X. 

Pixel data obtained from opposed pixels in 
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closest proximity to the interpolated pixel X may 
be extracted from the pixel data selected at the step 
52, to take the extracted pixel data as the pixel 
data x on the interpolated pixel X. In this case, 
when there are two pixel data obtained from the set 
of opposed pixels in closest proximity to the 
interpolated pixel X, the average of the pixel data 
is taken as the pixel data x on the interpolated pixel 
X . 

When it is judged at the foregoing step 49 that 
the settable ranges SL and SR respectively found by 
the edge components ELI and ER1 are not overlapped 
with each other, the average ( d 1 2 + d 1 3 + d 2 2 + d 2 3 ) / 4 of 
the pixel data dl2, dl3 f d22, and d23 on the four 
original pixels D12, D13, D22, and D23 is determined 
as the pixel data x on the interpolated pixel X (step 
5 4). 

When image interpolation is performed using the 
fourth image interpolating method in the image 
interpolating device configured as shown in Fig. 7 
or 8, the correlation value operating unit 2 may be 
caused to perform the processing at the steps 41 to 
51 and the step 54 shown in Fig. 21. 
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CLAIMS 

1. In an image interpolating method for 
interpolating a pixel at an intermediate position 
between a first original pixel and a second original 
pixel adjacent to the first original pixel, an image 
interpolating method is characterized by 
comprising: 

a first step of calculating an edge component 
for judging whether or not an interpolated pixel 
exists in the vicinity of an edge position of 
original image data; 

a second step of finding a range where pixel data 
on the interpolated pixel is settable on the basis 
of the calculated edge component and pixel data on 
the first and second original pixels; 

a third step of selecting a plurality of sets 
of opposed pixels between which the interpolated 
pixel is sandwiched diagonally, and finding, for 
each of the sets, the pixel data on the interpolated 
pixel in a case where a correlation value represented 
by the sum of the absolute values of the differences 
between the pixel data on the interpolated pixel and 
pixel data on the opposed pixels is the minimum in 
the range where the pixel data on the interpolated 
pixel is settable and the minimum correlation value; 
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and 

a fourth step of finding the pixel data on the 
interpolated pixel on the basis of the pixel data 
on the interpolated pixel in the case where the 
correlation value is the minimum and the minimum 
correlation value which are found for each of the 
sets. 

2. The image interpolating method according to 
claim 1 , characterized in that when an original pixel 
adjacent to the first original pixel and opposite 
to the second original pixel is taken as a third 
original pixel, and an original pixel adjacent to 
the second original pixel and opposite to the first 
original pixel is taken as a fourth original pixel, 
the edge component is calculated on the basis of 
pixel data on the first to fourth original pixels 
at the first step. 

3. The image interpolating method according to 
claim 2, characterized in that letting dl be the 
pixel data on the first original pixel, d2 be the 
pixel data on the second original pixel, d3 be the 
pixel data on the third original pixel, and d4 be 
the pixel data on the fourth original pixel, an edge 
component E is calculated on the basis of an equation 
for operation E = -d3 + dl + d2 - d4. 
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4. The image interpolating method according to 
claim 3, characterized in that letting E be the edge 
component found at the first step, Th be a 
predetermined threshold, d max be the larger one of 
the pixel data on the first original pixel and the 
pixel data on the second original pixel, d m i n be the 
smaller one of them, and d be d meLX ~d m i n , a range S where 
the pixel data on the interpolated pixel is settable 
is found on the basis of the following expression 
at the second step: 

if E > Th, then d min + d/2 S. S ^ dm ax , 
if -Th S E ^ Th, then d min + d / 4 ^ S S d max - 
d / 4 , and 

if E < -Th, then d min ^ S ^ d min + d/2. 

5. The image interpolating method according to 
claim 1, characterized in that letting x be the pixel 
data in the settable range S found at the second step, 
and da and db be respectively the pixel data on the 
two original pixels composing one set of opposed 
pixels, a correlation value L corresponding to the 
set is calculated by L = I da-x | + | db-x | . 

6. The image interpolating method according to 
claim 1, characterized in that the fourth step 
comprises the steps of 

selecting the minimum of the minimum 
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correlation values found for the sets at the third 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

determining, when there are a plurality of 
minimums of the minimum correlation values, the 
average of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum 
correlation values are respectively given as the 
pixel data on the interpolated pixel. 

7. The image interpolating method according to 
claim 1, characterized in that the fourth step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the third 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 
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determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

extracting, when there are a plurality of 
minimums of the minimum correlation values, the 
maximum and the minimum of the pixel data on the 
interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 
given , and determining the average of the extracted 
maximum and minimum as the pixel data on the 
interpolated pixel. 

8. The image interpolating method according to 
claim 1 , characterized in that the fourth step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the third 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
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of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

selecting, when there are a plurality of 
minimums of the minimum correlation values, the 
pixel data obtained from opposed pixels in closest 
proximity to the interpolated pixel out of the pixel 
data on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given, and determining, when the number 
of the selected pixel data is one, the pixel data 
as the pixel data on the interpolated pixel, while 
determining, when the number of the selected pixel 
data is two, the average of the pixel data as the 
pixel data on the interpolated pixel. 

9. In an image interpolating method for 
interpolating a pixel at an intermediate position 
between a first original pixel and a second original 
pixel adjacent to the first original pixel, an image 
interpolating method is characterized by 
comprising: 

a first step of calculating an edge component 
for judging whether or not an interpolated pixel 
exists in the vicinity of an edge position of 
original image data; 

a second step of correcting the calculated edge 
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component on the basis of a predetermined pseudo 
noise component; 

a third step of finding a range where pixel data 
on the interpolated pixel is settable on the basis 
of an edge component after the correction and pixel 
data on the first and second original pixels; 

a fourth step of selecting a plurality of sets 
of opposed pixels between which the interpolated 
pixel is sandwiched diagonally, and finding, for 
each of the sets, the pixel data on the interpolated 
pixel in a case where a correlation value represented 
by the sum of the absolute values of the differences 
between the pixel data on the interpolated pixel and 
pixel data on original pixels in the vicinity of the 
opposed pixels is the minimum in the range where the 
pixel data on the interpolated pixel is settable and 
the minimum correlation value; and 

a fifth step of finding the pixel data on the 
interpolated pixel on the basis of the pixel data 
on the interpolated pixel in the case where the 
correlation value is the minimum and the minimum 
correlation value which are found for each of the 
sets. 

10. The image interpolating method according 
to claim 9, characterized in that when an original 
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pixel adjacent to the first original pixel and 
opposite to the second original pixel is taken as 
a third original pixel, and an original pixel 
adjacent to the second original pixel and opposite 
to the first original pixel is taken as a fourth 
original pixel, the edge component is calculated on 
the basis of pixel data on the first to fourth 
original pixels at the first step. 

11. The image interpolating method according 
to claim 9, characterized in that letting dl be the 
pixel data on the first original pixel, d2 be the 
pixel data on the second original pixel , d3 be the 
pixel data on the third original pixel, and d 4 be 
the pixel data on the fourth original pixel, an edge 
component E is calculated on the basis of an equation 
for operation E = - d3 + dl + d2 - d4. 

12. The image interpolating method according 
to claim 11, characterized in that letting Q be a 
pseudo noise component, and E be the edge component 
calculated at the first step, an edge component El 
after the correction found at the second step is 
given by the following expression: 

if -Q ^ E ^ Q, then El = 0, and 
if E > Q or E < - Q , then El = E. 

13. The image interpolating method according 



to claim 12, characterized in that letting El be the 
edge component after the correction found at the 
second step, d ma x be the larger one of the pixel data 
on the first original pixel and the pixel data on 
the second original pixel, dmin be the smaller one 
of them, dc be the average of d ma x and d m i n , and a 
(0 S a ^ 1) and y be previously set factors, a range 
S where the pixel data on the interpolated pixel is 
settable is found on the basis of the following 
expression at the third step: 

if El S 0, then d min ■ a + dc(l-a) ^ S ^ d ma x • 
a + dc(l-a) + El • y , and 

if El < 0, then d min • ct + dc(l-a) + El - 7 = S 
= d ma x ' oi + dc ( 1 - a ) . 

14. The image interpolating method according 
to claim 9, characterized in that 

when a direction connecting the first original 
pixel and the second original pixel is defined as 
a vertical direction, a direction perpendicular to 
the vertical direction is defined as a right- 
and-left direction, a set of opposed pixels is taken 
as D12 and D24, two original pixels adjacent to the 
one opposed pixel D 1 2 on the right and left sides 
are taken as Dll and D13, two original pixels 
adjacent to the opposed pixel D12 on the upper and 



lower sides are taken as D02 and D22, two original 
pixels adjacent to the other opposed pixel D24 on 
the right and left sides are taken as D23 and D25, 
two original pixels adjacent to the opposed pixel 
D24 on the upper and lower sides are taken as D14 
and D34, pixel data on the original pixels D02, Dll, 
D12, D13, D14, D22, D23, D24, D25, and D34 are 
respectively taken as d02, dll, d 1 2 , dl3, dl4, d22, 
d23, d24, d25, and d34, j3 1 and jS 2 are taken as 
predetermined factors, and the pixel data in the 
settable range S found at the third step is taken 
as x, an equation for calculating the correlation 
value L corresponding to the set is expressed by the 
following equations: 

L = |dl2-x| + |d24-x| + j8l*Hl - j3 2 -VI 
HI = MAX{ ( | dll-dl2 | + | dl2-dl3 | ) , (|d23-d24| + 
| d 2 4 - d 2 5 | ) } 

VI = MIN{ (|d02-dl2| + | dl2-d22 I ) , ( | dl4-d2 4 | + 
| d2 4-d3 4 | ) } 

15. The image interpolating method according 
to claim 9, characterized in that the fifth step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the fourth 



extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one r the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

determining, when there are a plurality of 
minimums of the minimum correlation values, the 
average of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum 
correlation values are respectively given as the 
pixel data on the interpolated pixel. 

16- The image interpolating method according 
to claim 9, characterized in that the fifth step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the fourth 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
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on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

extracting, when there are a plurality of 
minimums of the minimum correlation values, the 
maximum and the minimum of the pixel data on the 
interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 
given, and determining the average of the extracted 
maximum and minimum as the pixel data on the 

interpolated pixel. 

17. The image interpolating method according 

to claim 9, characterized in that the fifth step 

comprises the steps of 

selecting the minimum of the minimum 

correlation values found for the sets at the fourth 

step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given; 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 
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selecting, when there are a plurality of 
minimums of the minimum correlation values, the 
pixel data obtained from opposed pixels in closest 
proximity to the interpolated pixel out of the pixel 
data on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given, and determining, when the number 
of the selected pixel data is one, the pixel data 
as the pixel data on the interpolated pixel, while 
determining, when the number of the selected pixel 
data is two, the average of the pixel data as the 
pixel data on the interpolated pixel. 

18. In an image interpolating method for 
interpolating a pixel at a central position among 
four original pixels comprising a first original 
pixel and a second original pixel which are adjacent 
to each other on the right and left sides, a third 
pixel adjacent to the first original pixel on the 
lower side, and a fourth pixel adjacent to the second 
original pixel on the lower side, an image 
interpolating method is characterized by 
comprising: 

a first step of calculating a first edge 
component for judging whether or not an interpolated 
pixel exists in the vicinity of an edge position of 
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original image data on the basis of pixel data on 
the first original pixel, the fourth original pixel, 
a fifth original pixel on an extension of a line 
connecting the first original pixel and the fourth 
original pixel and adjacent to the first original 
pixel diagonally to the upper left, and a sixth 
original pixel on the extension of the line 
connecting the first original pixel and the fourth 
original pixel and adjacent to the fourth original 
pixel diagonally to the lower right; 

a second step of calculating a second edge 
component for judging whether or not the 
interpolated pixel exists in the vicinity of the edge 
position of the original image data on the basis of 
pixel data on the second original pixel, the third 
original pixel, a seventh original pixel on an 
extension of a line connecting the second original 
pixel and the third original pixel and adjacent to 
the second original pixel diagonally to the upper 
right, and an eighth original pixel on the extension 
of the line connecting the second original pixel and 
the third original pixel and adjacent to the third 
original pixel diagonally to the lower left; 

a third step of finding a first range where pixel 
data on the interpolated pixel is settable on the 
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basis of the first edge component and the pixel data 
on the first and fourth original pixels and a second 
range where the pixel data on the interpolated pixel 
is settable on the basis of the second edge component 
and the pixel data on the second and third original 
pixels ; 

a fourth step of judging whether or not portions 
which are overlapped with each other exist in the 
first settable range and the second settable range; 

a fifth step of calculating, when there exist 
no portions which are overlapped with each other in 
the first settable range and the second settable 
range, the average of the pixel data on the first 
to fourth original pixels, and determining the 
result of the calculation as the pixel data on the 
interpolated pixel; 

a sixth step of setting, when there exist 
portions which are overlapped with each other in the 
first settable range and the second settable range, 
the overlapped portions as a settable range, then 
selecting a plurality of sets of opposed pixels 
between which the interpolated pixel is sandwiched 
diagonally, and finding, for each of the sets, the 
pixel data on the interpolated pixel in a case where 
a correlation value represented by the sum of the 
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absolute values of the differences between the pixel 
data on the interpolated pixel and pixel data on the 
opposed pixels is the minimum in the range where the 
pixel data on the interpolated pixel is settable and 
the minimum correlation value; and 

a seventh step of finding the pixel data on the 
interpolated pixel on the basis of the pixel data 
on the interpolated pixel in the case where the 

^ ~ correlation value is the minimum and the minimum 

correlation value which are found for each of the 

' *r sets at said sixth step. 

n! 19. The image interpolating method according 

q to claim 18, characterized in that 

rj letting dl be the pixel data on the first 

;1; original pixel, d4 be the pixel data on the fourth 

original pixel, d5 be the pixel data on the fifth 
original pixel, d6 be the pixel data on the sixth 
original pixel, and EL be a first edge component, 
the first edge component EL is calculated on the 
basis of an equation for operation EL = -d5 + dl + 
d4 - d6 at the first step, and 

letting d2 be the pixel data on the second 
original pixel, d3 be the pixel data on the third 
original pixel, dl be the pixel data on the seventh 
original pixel, d8 be the pixel data on the eighth 
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original pixel, and ER be a second edge component, 
the second edge component ER is calculated on the 
basis of an equation for operation ER = -d7 + d2 + 
d3 - d8 at the second step. 

20. The image interpolating method according 
to claim 19, characterized in that letting EL be the 
first edge component, ER be the second edge 
component, Th be a predetermined threshold, dL max be 
the larger one of the pixel data on the first original 
pixel and the pixel data on the fourth original 
pixel, dL min be the smaller one of them, dL be 
dL max - dL min , dR m ax be the larger one of the pixel data 
on the second original pixel and the pixel data on 
the third original pixel, dR mxn be the smaller one 
of them, and dR be d Rmax - d R mi n , a first settable range 
SL and a second settable range SR are found on the 
basis of the following expressions at the third step: 
if EL > Th, then dL min + dL/2 ^ SL ^ dL max , 
if -Th ^ EL ^ Th, then dL min + dL/4 < SL ^ dL raax 

- dL/4, and 

if EL < -Th, then dL min ^ SL ^ dL min + dL/2. 
if ER > Th, then dR min + dR/2 ^ SR ^ dR max , 
if -Th ^ ER ^ Th, then dR min + dR/4 ^ SR ^ dR max 

- dR/4, and 

if ER < -Th, then dR min ^ SR ^ dR m m + dR/2. 
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21. The image interpolating method according 
to claim 18, characterized in that letting x be the 
pixel data in the settable range S set at the sixth 
step, and da and db be respectively the pixel data 
on the two original pixels composing one set of 
opposed pixels, a correlation value L corresponding 
to the set is calculated by L = | da-x | + I db-x | . 

22. The image interpolating method according 
to claim 18, characterized in that the seventh step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the sixth 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

determining, when there are a plurality of 
minimums of the minimum correlation values, the 
average of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum 
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correlation values are respectively given as the 
pixel data on the interpolated pixel. 

23. The image interpolating method according 
to claim 18, characterized in that the seventh step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the sixth 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

extracting, when there are a plurality of 
minimums of the minimum correlation values, the 
maximum and the minimum of the pixel data on the 
interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 
given, and determining the average of the extracted 
maximum and minimum as the pixel data on the 
interpolated pixel. 

24. The image interpolating method according 
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to claim 18, characterized in that the seventh step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the sixth 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

selecting, when there are a plurality of 
minimums of the minimum correlation values, the 
pixel data obtained from opposed pixels in closest 
proximity to the interpolated pixel out of the pixel 
data on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given, and determining, when the number 
of the selected pixel data is one, the pixel data 
as the pixel data on the interpolated pixel, while 
determining , when the number of the selected pixel 
data is two, the average of the pixel data as the 
pixel data on the interpolated pixel. 
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2 5 . 



In an image interpolating method for 



interpolating a pixel at a central position among 
four original pixels comprising a first original 
pixel and a second original pixel which are adjacent 
to each other on the right and left sides, a third 
pixel adjacent to the first original pixel on the 
lower side, and a fourth pixel adjacent to the second 
original pixel on the lower side, an image 
interpolating method is characterized by 
c o mp rising : 



component for judging whether or not an interpolated 
pixel exists in the vicinity of an edge position of 
original image data on the basis of pixel data on 
the first original pixel, the fourth original pixel, 
a fifth original pixel on an extension of a line 
connecting the first original pixel and the fourth 
original pixel and adjacent to the first original 
pixel diagonally to the upper left, and a sixth 
original pixel on the extension of the line 
connecting the first original pixel and the fourth 
original pixel and adjacent to the fourth original 
pixel diagonally to the lower right; 



a first step of 



calculating a first edge 



a second step of 



calculating a second edge 



c 



o 



mponent for judging 



whether or not the 
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interpolated pixel exists in the vicinity of the edge 
position of the original image data on the basis of 
pixel data on the second original pixel, the third 
original pixel, a seventh original pixel on an 
extension of a line connecting the second original 
pixel and the third original pixel and adjacent to 
the second original pixel diagonally to the upper 
right, and an eighth original pixel on the extension 
of the line connecting the second original pixel and 
the third original pixel and adjacent to the third 
original pixel diagonally to the lower left; 

a third step of respectively correcting the 
calculated first and second edge components on the 
basis of predetermined pseudo noise components; 

a fourth step of finding a first range where 
pixel data on the interpolated pixel is settable on 
the basis of a first edge component after the 
correction and the pixel data on the first and fourth 
original pixels and a second range where the pixel 
data on the interpolated pixel is settable on the 
basis of a second edge component after the correction 
and the pixel data on the second and third original 
pixels ; 

a fifth step of judging whether or not portions 
which are overlapped with each other exist in the 
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first settable range and the second settable range; 

a sixth step of calculating, when there exist 
no portions which are overlapped with each other in 
the first settable range and the second settable 
range, the average of the pixel data on the first 
to fourth original pixels, and determining the 
result of the calculation as the pixel data on the 
interpolated pixel; 

a seventh step of setting, when there exist 
portions which are overlapped with each other in the 
first settable range and the second settable range, 
the overlapped portions as a settable range, then 
selecting a plurality of sets of opposed pixels 
between which the interpolated pixel is sandwiched 
diagonally, and finding, for each of the sets, the 
pixel data on the interpolated pixel in a case where 
a correlation value represented by the sum of the 
absolute values of the differences between the pixel 
data on the interpolated pixel and pixel data on the 
opposed pixels and pixel data on original pixels in 
the vicinity of the opposed pixels is the minimum 
in the range where the pixel data on the interpolated 
pixel is settable and the minimum correlation value; 
and 

an eighth step of finding the pixel data on the 
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interpolated pixel on the basis of the pixel data 
on the interpolated pixel in the case where the 
correlation value is the minimum and the minimum 
correlation value which are found for each of the 
sets. 

26. The image interpolating method according 
to claim 25, characterized in that 

letting dl be the pixel data on the first 

fj 

[% - original pixel, d4 be the pixel data on the fourth 

original pixel, d5 be the pixel data on the fifth 
:= j: original pixel, and d6 be the pixel data on the sixth 

fn original pixel, and EL be a first edge component, 

Q the first edge component EL is calculated on the 

Q basis of an equation for operation EL = - d 5 + dl + 

O d4 - d6 at the first step, and 

letting d2 be the pixel data on the second 
original pixel, d3 be the pixel data on the third 
original pixel, d7 be the pixel data on the seventh 
original pixel, and d8 be the pixel data on the eighth 
original pixel, and ER be a second edge component, 
the second edge component ER is calculated on the 
basis of an equation for operation ER = -d7 + d2 + 
d3 - d8 at the second step. 

27. The image interpolating method according 
to claim 26, characterized in that letting Q be a 
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p s e u ci o noise component, EL be the first edge 
component, and ER be the second edge component, a 
first edge component ELI after the correction and 
a second edge component ER1 after the correction 
which are found at the third step are given by the 
following expressions : 

if -Q ^ EL £ Q, then ELI = 0, and 
if EL > Q or EL < -Q, then ELI = EL. 
if -Q ^ ER ^ Q, then ER1 = 0, and 
if ER > Q or ER < -Q, then ER1 = ER. 
28. The image interpolating method according 
to claim 27, characterized in that letting ELI be 
the first edge component after the correction, ER1 
be the second edge component after the correction, 
o!L max be the larger one of the pixel data on the first 
original pixel and the pixel data on the fourth 
original pixel, dL min be the smaller one of them, dLc 
be the average of dL max and dL min , dR max be the larger 
one of the pixel data on the second original pixel 
and the pixel data on the third original pixel, dR m i n 
be the smaller one of them, dRc be the average of 

dR max and dR min , and a and y be previously set factors, 
a first settable range SL and a second settable range 
SR are found on the basis of the following 
expressions at the fourth step: 
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if ELI ^ 0, then dL min -a + dLc(l-a) ^ SL ^ 
dL max - a + dLc(l-a) + ELI • y , and 

if ELI < 0, then dL min ■ a + dLc(l-a) + ELI* 
y ^ SL^ d L m a x • a + dLc(l-a). 

if ER1 ^ 0, then dR miri - a + dRc(l-a) S SR ^ dR ma x* 
a + dRc(l-a) + E R 1 • y , and 

if ER1 < 0, then dR min *ct + dRc(l-a) + ER1 • y ^ 
SR^ dR maK - a + dRc ( 1 - a ) . 

29. The image interpolating method according 
to claim 25, characterized in that letting x be the 
pixels data in the settable range S set at the seventh 
step, and da and db be respectively the pixel data 
on the two original pixels composing one set of 
opposed pixels, a correlation value L corresponding 
to the set is calculated by L = |da-x| + |db-x|. 

30. The image interpolating method according 
to claim 25, characterized in that the eighth step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the seventh 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
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minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

determining, when there are a plurality of 
minimums of the minimum correlation values, the 
average of the pixel data on the interpolated pixel 
in a case where the minimums of the minimum 
correlation values are respectively given as the 
pixel data on the interpolated pixel. 

31. The image interpolating method according 
to claim 25, characterized in that the eighth step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the seventh 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given, 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

extracting, when there are a plurality of 



minimums of the minimum correlation values, the 
maximum and the minimum of the pixel data on the 
interpolated pixel in a case where the minimums of 
the minimum correlation values are respectively 
given, and determining the average of the extracted 
maximum and minimum as the pixel data on the 
interpolated pixel. 

32. The image interpolating method according 
to claim 25, characterized in that the eighth step 
comprises the steps of 

selecting the minimum of the minimum 
correlation values found for the sets at the seventh 
step, 

extracting the pixel data on the interpolated 
pixel in a case where the selected minimum of the 
minimum correlation values is given; 

determining, when the number of minimums of the 
minimum correlation values is one, the pixel data 
on the interpolated pixel in a case where the minimum 
of the minimum correlation values is given as the 
pixel data on the interpolated pixel, and 

selecting, when there are a plurality of 
minimums of the minimum correlation values, the 
pixel data obtained from opposed pixels in closest 
proximity to the interpolated pixel out of the pixel 



data on the interpolated pixel in a case where the 
minimums of the minimum correlation values are 
respectively given, and determining, when the number 
of the selected pixel data is one, the pixel data 
as the pixel data on the interpolated pixel, while 
determining, when the number of the selected pixel 
data is two, the average of the pixel data as the 
pixel data on the interpolated pixel. 



A B S T RACT 

An image interpolating method for 
interpolating a pixel at an intermediate position 
between a first original pixel and a second original 
pixel adjacent to the first original pixel, 
comprising a first step of calculating an edge 
component for judging whether or not an interpolated 
pixel is positioned in the vicinity of an edge 
position of original image data , a second step of 
determining a range where pixel data on the 
interpolated pixel is settable on the basis of the 
calculated edge component andpixel data on the first 
and second original pixels, and a third step of 
selecting a plurality of sets of opposed pixels 
between which the interpolated pixel is sandwiched 
diagonally, and determining, for each of the sets, 
the pixel data on the interpolated pixel in a case 
where a correlation value represented by the sum of 
the absolute values of the differences between the 
pixel data on the interpolated pixel and pixel data 
on the opposed pixels is the minimum in the range 
where the pixel data on the interpolated pixel is 
settable and the minimum correlation value. 
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